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(54) Apparatus for controlling the display of data, apparatus for transmitting of display control 
information and an apparatus for editing of the said display control information 



(57) A data display control apparatus receives a dig- 
ital broadcast and compares the present time with a time 
indicated in a Time_Event_Part provided in navigation 
information used to control the display of the multimedia 



data composing a broadcast program. When the indi- 
cated time has been reached, the data display control 
apparatus executes instructions to control the display of 
the multimedia data. 



CM 
< 

o> 

o 
o 

CO 
CO 

o 

CL 
LU 



Printed by Jouve. 75001 PARIS (FR) 



1 



EP0 830 019 A2 



2 



Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to a data display con- 
trol apparatus, a data transmission apparatus, and a da- 
ta display control information editing apparatus. In par- 
ticular, the present invention relates to a data display 
control apparatus for controlling the display of a plurality 
of sets of multimedia data which are linked to one an- 
other, a data transmission apparatus for transmitting in- 
formation controls the display of multimedia data, and 
to a data display control information editing apparatus 
for editing information used to control the display of mul- 
timedia data. 

2. Description of the Related Art 

Since the development of digital satellite broadcast- 
ing in recent years, there has been a great increase in 
the number of programs being provided on an ever 
greater number of channels. For digital satellite broad- 
casting, large numbers of channels are possible by mul- 
tiplexing the channels together into a single frequency 
band. This multiplexing is performed using what is called 
a "transport stream" under MPEG2 (Moving Pictures 
Experts Group2) standard. This technique is described 
in detail in the documentation for I SO/I EC Standard 
13818-1 (MPEG2 system standard). 

Here, it is possible to conceive a digital broadcast- 
ing system where image information and the like are 
transmitted from a transmission station and received by 
a receiver terminals, with users of the receiver terminals 
making interactive operations for the image information 
in accordance with the content of the transmitted image 
information. 

The above kind of 'digital broadcasting system is 
disclosed by a concurrent patent application with the title 
"Digital Broadcasting System, Digital Broadcasting Ap- 
paratus, and Receiver Apparatus for a Digital Broad- 
cast" (Japanese Patent Application No. H9-62216). The 
characteristic feature of this digital broadcasting system 
is that it provides a variety of interactive services using 
only a one-way transfer of data. The system is described 
in more detail below. 

The construction of the digital broadcasting system 
which is presupposed for the present invention is shown 
in Fig. 1. This digital broadcasting system is composed 
of a data transmission apparatus 101 and a plurality of 
data reception apparatuses 121. 

Data Transmission Apparatus 101 

The data transmission apparatus 101 is construct- 
ed to multiplex data for a plurality of contents, which fea- 
ture hyperlinks to one another, into an MPEG2 transport 



stream and to repeatedly transmit the multiplexed data. 
This data transmission apparatus 101 is composed of a 
transmission data storage unit 102, a data multiplexing 
unit 103, a multiplexing information storage unit 104, a 
5 system information table generating unit 105, and a 
transmission unit 106. Here, the term "content" is used 
to express the unit of information for which interactive 
operations can be performed by the user. 

The transmission data storage unit 102 is com- 

10 posed of a recording medium such as a magnetic disc, 
and stores data for a plurality of contents which com- 
pose one interactive program, and construction informa- 
tion. This transmission data storage unit 102 includes a 
presentation information storage unit 107, a navigation 

*5 information storage unit 108, and a construction infor- 
mation storage unit 109. Here, an "interactive program'' 
refers to an "event" or "program" which is included in the 
MPEG2 transport stream used as the transmission data. 
The presentation information storage unit 107 

20 stores presentation information, such as image data and 
audio data, which is included in each content. The nav- 
igation information storage unit 1 08 stores the naviga- 
tion information which is composed of hyperlink infor- 
mation for links to other contents, operation control in- 

25 formation such as scripts for switch in^the display, and 
supplementary display images for displaying menus 
and the like on a display screen. The construction infor- 
mation storage unit 109, meanwhile, stores a construc- 
tion information table which shows the correspondence 

30 between sets of image data and navigation information. 
The multiplexing information storage unit 104 
stores a multiplexing information table including identi- 
fiers and assigning information for resources such as 
bandwidth for multiplexing the transmission data stored 

35 jn the transmission data storage unit 102 into an MPEG2 
transport stream. 

This multiplexing information table includes packet 
identifiers (PID) which are assigned to the components 
that compose each event, when the data stored in the 

40 transmission data storage unit 102 is multiplexed into 
the MPEG2 transport stream as an event. 

The components referred to here are streams which 
are each identified by a PID under IS/I EC 13818 : t 
(hereinafter, MPEG2 system) standard, with there being 

45 video components, audio components, components for 
multiplexing navigation information, and components 
for multiplexing stream correspondence information 
(described later in this specification). 

The data multiplexing unit 103 is composed of a 

50 multiplexing control unit 110 made up of a CPU and 
memory, a stream correspondence information table 
generating unit 111, an identifier information appending 
unit 112, a navigation information table generating unit 
113, and a multiplexing unit 114. r 

55 On being activated by the transmission unit 1 06, the 
multiplexing control unit 110 first reads the construction 
information table and the multiplexing information table 
stored in the construction information storage unit 1 09 
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and the multiplexing information storage unit 104, and 
assigns identifiers for uniquely identifying each content 
in the digital broadcast for each content number, in doing 
so generating a content identifier assigning table. After 
this, the multiplexing control unit 110 assigns values of 
a "PID", "component_tag M , and "stream jd" to each set 
of image data and generates a display image informa- 
tion identifier assigning table. The multiplexing control 
unit 110 also instructs the stream correspondence infor- 
mation table generating unit 111 to generate a stream 
correspondence table, instructs the identifier informa- 
tion appending unit 112 to add the identifier VE_id for 
image data (video element n VE n ) to the private area of 
the image data, and instructs the navigation information 
table generating unit 113 to generate the navigation in- 
formation table for the navigation elements "NE". 

On being instructed by the multiplexing control unit 
110 to add the identifier information, the identifier infor- 
mation appending unit 112 reads the image data stored 
in the presentation information storage unit 107. The 
identifier information appending unit 112 then writes the 
image data identifier VE_id into the private area of the 
image data bit stream it has read. It should be noted 
here that the identifier information appending unit 112 
obtains the VE_id by referring to the display image in- 
formation identifier assigning table generated by the 
multiplexing control unit 110. The identifier information 
appending unit 112 then assigns afilename to the image 
data bitstream with the added VE_id information and 
stores it in a storage area (not illustrated). After append- 
ing identifier information to all of the image data, the 
identifier information appending unit 112 informs the 
multiplexing control unit 1 1 0 of the completion of the ap- 
pending operation. 

On being instructed by the multiplexing control unit 
110 to generate a navigation information table, the nav- 
igation information table generating unit 113 reads the 
navigation information stored in the navigation informa- 
tion storage unit 108. When the read navigation infor- 
mation includes hyperlink information, the navigation in- 
formation table generating unit 11 3 refers to the content 
identifier assigning table for information regarding the 
link destination given as a content number and converts 
this content number into a variety of identifiers to gen- 
erate a navigation information table. When no hyperlink 
information is included, the navigation information table 
generating unit 113 generates the navigation informa- 
tion table by using the read navigation information as it 
is, changing only the filename. The navigation informa- 
tion table generating unit 1 1 3 stores the generated nav- 
igation information table in a storage area (not illustrat- 
ed). Hereinafter, the expression "navigation informa- 
tion" will mainly refer to the navigation information tables 
generated here. 

On completing the generation of the navigation in- 
formation tables, the navigation information table gen- 
erating unit 1 1 3 informs the multiplexing control unit 1 1 0 
of the completion of its processing. 



On being instructed by the multiplexing control unit 
110 to generate a stream correspondence table, the 
stream correspondence information table generating 
unit 1 1 1 refers to the display image information identifier 

5 assigning table and generates a stream correspond- 
ence table for each set of image data. These stream cor- 
respondence tables are used by data reception appara- 
tuses to separate one set of image data from the stream 
transmitted from the data transmission apparatus 101 

10 to the data reception apparatus 121. Hereinafter, the ex- 
pression "stream correspondence information" will 
mainly refer to the stream correspondence tables gen- 
erated here. 

On completing the generation of the stream corre- 
15 spondence tables, the stream correspondence informa- 
tion table generating unit 111 informs the multiplexing 
control unit 110 of the completion of its processing. 

On receiving indications for the completion of 
processing by the identifier information appending unit 
20 112, the navigation information table generating unit 
1 1 3, and the stream correspondence information table 
generating unit 111, the multiplexing control unit 110 de- 
cides the number of contents which are to be repeatedly 
transmitted. 

25 The multiplexing unit 1 1 4 multiplexes the transmis- 
sion data into an MPEG2 transport stream. 

The system information table genierating unit 105 
refers to the multiplexing information storage unit 104 
and generates the NIT (Network Information Table), the 

30 EIT (Event Information Table), the SDT (Service De- 
scription Table), the PAT (Program Association Table), 
and the PMT (Program Map Table). These tables com- 
pose the program specification information which is 
used by the data reception apparatus 121 in selecting 

35 a program. Hereinafter, the tables, such as the NIT and 
EIT, generated by the system information table gener- 
ating unit 1 05 will be generally referred to as the "system 
information". 

On being instructed by the multiplexing control unit 

40 no, the system information table generating unit 105 
refers to the multiplexing information storage unit 104 
and generates the NIT, the EIT, the SDT, and the PAT in 
accordance with DVB-SI standard and MPEG2 system 
standard. These tables include information which is re- 

45 quired by the data reception apparatus 121 to select the 
events which are composed of the data stored in the 
transmission data storage unit 102. 

The NIT stores information which relates to the 
transfer path for each transport stream transmitted from 

50 a network identified as the specified network. The EIT 
stores information, such as event names, starting times, 
and ending times, for each of the events in a specified 
service. The SDT stores information, such as service 
names, for each service included in a specified transport 

55 stream. 

The PAT includes information for the PIDs of the 
PMT (Program Map Table) for each program included 
in a specified transport stream. 
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The system information table generating unit 105 
also refers to the multiplexing information table and gen- 
erates the PMT. The PMT includes PIDs for identifying 
each component which composes a program, the types 
of data transmitted in each component, and information 
for the descriptors which correspond to each compo- 
nent. 

The transmission unit 1 06 includes a scheduler, and 
activates the multiplexing control unit 110 at a predeter- 
mined time before the transmission start time of an 
event, such as five minutes before transmission. When 
the transmission start time is reached, the transmission 
unit 1 06 repeatedly multiplexes information such as the 
NIT, PAT, PMT, SDT, and EIT generated by the system 
information table generating unit 105 into the transport 
stream outputted by the multiplexing unit 114 at a pre- 
determined interval using predetermined PIDs in ac- 
cordance with DVB-SI standard and MPEG2 system 
standard. The transmission unit 106 then performs mod- 
ulation and other processes, before transmitting the da- 
ta to a plurality of data reception apparatuses 121 . 

As described above, the data transmission appara- 
tus 101 assigns identifiers to the image data and navi- 
gation information table which compose each content, 
multiplexes them into a transport stream, and repeated- 
ly performs transmission. 

The navigation information includes identifiers of a 
set of image data and a set of navigation information in 
the content linked by a hyperlink, as well as supplemen- 
tary image information for displaying menus and the like, 
and scripts for switching the display. As a result, the data 
reception apparatus 121 can freely separate and repro- 
duce a content from the transport stream by specifying 
the identifiers in accordance with the navigation infor- 
mation, which means that interactive operations can be 
performed for data transmitted using a one-way com- 
munication path. 

Data Reception Apparatus 

The data reception apparatus 121 is constructed to 
selectively obtain and reproduce a content from the 
MPEG2 transport stream transmitted by the data trans- 
mission apparatus 101, in accordance with an interac- 
tive operation made by the user. This data reception ap- 
paratus 121 is composed of a reception unit 122, a TS 
decoder unit 123, an AV decoder unit 124, a received 
data storage unit 125, a reception control unit 126, a 
signal reception unit 127, a reproduction unit 128, a dis- 
play unit 129, and an audio output unit 130. 

The reception unit 122 receives the MPEG2 trans- 
port stream which corresponds to the transport stream 
identifier indicated by the reception control unit 126, and 
outputs it to the TS decoder unit 123. 

The TS decoder unit (transport decoder unit) 123 
includes a filter condition storage unit 1 31 for storing the 
filter conditions set by the reception control unit 126, and 
operates in accordance with these filter conditions so as 



to only separate image data or audio data with a spec- 
ified identifier from the transport stream outputted by the 
reception unit 1 22. The TS decoder unit 1 23 outputs the 
separated data to the AV decoder unit 124. The TS de- 
5 coder unit 1 23 also separates stream correspondence 
tables, navigation information tables, and system infor- 
mation tables which have been multiplexed as table da- 
ta under MPEG2 standard, and outputs the table data 
to areas maintained in the received data storage unit 

to 1 25, in accordance with the identifiers. 

The TS decoder unit 123 also separates the PCR 
(Program Clock Reference) with the specified identifier 
and outputs it to the AV decoder unit 124. It should be 
noted here that the filter condition storage unit 1 31 can 

75 simultaneously store a plurality of filter conditions and 
that the TS decoder unit 123 can simultaneously per- 
form a plurality of separation operations in parallel. 

The AV decoder unit 1 24 includes a clock unit which 
is not illustrated. This clock unit is synchronized to a 

20 standard time using the value of the PCR outputted by 
the TS decoder unit 123, and is used to measure time 
which is used as the standard for synchronized decod- 
ing of image data and audio data. 

On receiving image data and/or audio data from the 

25 TS decoder unit 1 23, the AV decoder u/iit 124 reads the 
identifier of the image data and/or audio data written in 
the private area, in accordance with an indication from 
the reception control unit 126, and notifies the reception 
control un it 1 26 of the identifier(s). Next, the AV decoder 

30 unit 124 decodes the image data and/or audio data in 
predetermined units in accordance with an indication 
from the reception control unit 126 and outputs the de- 
coded data to the reproduction unit 128 in synchroniza- 
tion with the clock unit, before informing the reception 

35 control unit 126 of the completion of the decoding. 

The received data storage unit 125 can be com- 
posed of RAM (Random Access Memory), for example, 
and is provided with a stream correspondence informa- 
tion table storage unit 1 32, a navigation information ta- 

40 ble storage unit 133, and a system information table 
storage unit 134. 

The stream correspondence information table stor- 
age unit 132 stores stream correspondence tables 
which have been separated by the TS decoder unit 1 23. 

45 The navigation information table storage unit 1 33 stores 
navigation information tables which have been separat- 
ed by the TS decoder unit 1 23. The system information 
table storage unit 1 34 stores the system information ta- 
bles, such as the NIT, the SDT, the EIT, the PAT, and the 

50 PMT, which have been separated by the TS decoder unit 
123. 

The signal reception unit 127 receives signals, such 
as remote controller operations made by a user, and in- 
forms the reception control unit 126 of the received sig- 
55 nals. 

The reproduction unit 128 superimposes graphics 
information included in the navigation information table 
outputted from the reception control unit 126 and image 
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data decoded by the AV decoder unit 1 24 in accordance 
with indications from the reception control unit 1 26. The 
reproduction unit 128 outputs this combined image to 
the display unit 129. The reproduction unit 128 also out- 
puts audio data decoded by the AV decoder unit 1 24 to 
the audio output unit 1 30. 

The display unit 129 can be realized by a CRT 
(Cathode Ray Tube) or liquid crystal display, and is used 
to display the images outputted by the reproduction unit 
128. 

The audio output unit 130 can be realized by a 
speaker, and is used to output the audio signal outputted 
by the reproduction unit 128. 

The reception control unit 126 is composed of a 
CPU and a program for controlling the CPU, The recep- 
tion control unit 126 controls the reception unit 122 and 
has it receive a desired transport stream. On receiving 
a user operation signal via the signal reception unit 1 27, 
the reception control unit 126 refers to the navigation 
information table presently stored in the navigation in- 
formation table storage unit 133 and sets the filter con- 
dition for the next navigation information table and the 
filter condition for the stream correspondence table for 
obtaining the image data in the filter condition storage 
unit 131 of the TS decoder unit 123. The reception con- 
trol unit 1 26 then refers to the stream correspondence 
table which has been newly separated by the TS decod- 
er unit 123 and stored in the stream correspondence in- 
formation table storage unit 132, and sets the filter con- 
dition for the image data in the filter condition storage 
unit 131. 

The reception control unit 1 26 judges whether the 
image data which has been separated by the reception 
control unit 126 is the appropriate image data by refer- 
ring to the image data identifier written into the private 
area of the image data. When the image data is the ap- 
propriate image data, the reception control unit 1 26 has 
the image data decoded and outputted to the reproduc- 
tion unit 128. When the image data is not the appropriate 
image data, the reception control unit 1 26 changes the 
filter condition in the filter condition storage unit 131 and 
gives another indication for the separation of a stream 
correspondence table. 

The reception control unit 126 also reads graphics 
data for objects included in the supplementary image 
information in the navigation information table separat- 
ed by the TS decoder unit 123. The reception control 
unit 126 also informs the reproduction unit 128 of this 
data and has the reproduction unit 128 combine the bit- 
map data with the image data. 

As described above, the data reception apparatus 
1 21 can separate the presentation information and nav- 
igation information for a specified content from the trans- 
port stream when necessary. By doing so, suitable link 
destination contents can be reproduced in accordance 
with user operations, so that interactive programs that 
can be changed in accordance with user operations can 
be achieved despite the communication being limited to 



a one-way broadcast from the data transmission appa- 
ratus. 

Operation 

5 

The following is an explanation of the data compo- 
sition of contents and of the operation for the display of 
contents by the data reception apparatus 1 21 in this dig- 
ital broadcasting system, with reference to the drawings. 
10 Fig. 2 shows an example display which is displayed 
by the data reception apparatus 1 21 in.the digital broad- 
casting system described above. This figure shows an 
example of a mail order program, with there being a con- 
tent 210 showing a mail order menu, a content 220 in- 
15 troducing video equipment, and a content 230 introduc- 
ing stereo equipment. Here, switching between these 
contents can be performed according to user opera- 
tions, as shown by the arrows 240, 241 , 242, and 243. 

When the content 210 showing the mail order menu 
is displayed on the display screen and the user selects 
and activates the "Video" button 21 1 , the display switch- 
es, as shown by arrow 240, from content 21 0 to a display 
of content 220 that introduces video equipment. Follow- 
ing this, if the user selects and activates the "Menu" but- 
ton 221, the display switches back tOjihe content 210 
showing the mail order menu, as shown by the arrow 
241. I 

In the same way, when the content 21 0 showing the 
mail order menu is displayed on the display screen and 
the user selects and activates the "Stereo" button 212, 
the display switches, as shown by arrow 243, from con- 
tent 21 0 to a display of content 230. Following this, if the 
user selects and activates the "Menu" button 231, the 
display switches back to the content 210 showing the 
mail order menu, as shown by the arrow 242. Here, but- 
tons 211, 212, 221, and 231 are provided in contents 
21 0, 220, and 230 to allow switches of display in accord- 
ance with the interactive operations made by the user. 

To achieve the switches of display in response to 
interactive operations described above, the data which 
composes each of the contents transmitted by the data 
transmission apparatus 101 needs to have the construc- 
tion described below. 

Fig. 3 is a simplified representation of the data 
transmitted by the data transmission apparatus. Here, 
the transmitted data 201 is composed of data represent- 
ing the various contents, and is repeatedly transmitted 
in its entirety, with each repeated transmission having a 
predetermined time period. This data is repeatedly 
transmitted to allow the data corresponding to a content 
selected by an indication of a link destination given by 
the user to be obtained at any given time. Since the data 
for the contents is repeatedly transmitted, the user will 
soon be able to obtain the data for the required content 
even when the user has commenced viewing midway 
through the broadcast of the program. 

The transmitted data 201 is composed of a plurality 
of sets of image data 215, 225, and 235, and a plurality 
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of sets of navigation information 216, 226, and 236 
which correspond to the sets of image data. These sets 
of image data 21 5, 225, and 235 correspond to the back- 
ground images of contents 21 0, 220, and 230 which are 
displayed on the display screen of the data reception 
apparatus 121. 

The sets of navigation information 216, 226, and 
236 include bitmap data for on-screen display graphics, 
such as buttons, which are displayed superimposed on- 
to the sets of image data 215, 225, and 235, scripts 
which describe operation processes corresponding to 
user operations, and hyperlinks showing contents that 
are link destinations for display switching of contents. 
This hyperlink information is composed of identifiers for 
the data, such as image data, and the navigation infor- 
mation which compose the link destination contents. 

The content 210 shown in Fig. 2 is achieved by the 
image data 215 and the navigation information 216. In 
the same way, content 220 shown in Fig. 2 is achieved 
by the image data 225 and the navigation information 
226, and content 230 shown in Fig. 2 is achieved by the 
image data 235 and the navigation information 236. 

Fig. 4 is a model representation of the repeated 
transmission of data 201 with the given interval. This da- 
ta 201 is repeatedly transmitted with the given interval 
by the data transmission apparatus 101. 

It should be noted that while the image data and 
navigation information in Fig. 4 have been illustrated 
with a frame construction, the respective data is in fact 
digitized, with image data and corresponding navigation 
information being multiplexed together and the data 201 
being transmitted as an MPEG2 transport stream. 

The following is a detailed explanation of the data 
multiplexed and transmitted by the data transmission 
apparatus 101. 

Fig. 5 shows how the data transmitted by the data 
transmission apparatus 101 is multiplexed together. As 
shown in the figure, image data VE(N), navigation infor- 
mation tables NE(N), stream correspondence tables 
VET(N), and system information such as the PC R, PAT, 
and PMTare multiplexed together. The arrow 202 in Fig. 
5 shows the range of the data 201 in Fig. 4 which is re- 
peatedly transmitted. 

In the example shown in Fig. 5, sixty-three contents 
are multiplexed together, with the sets of image data VE 
(0) to VE(62) each being multiplexed with the value 
"0x0084" as their PID and a value which is cyclically in- 
cremented between "OxeO" and "Oxef as their 
streamjd. Each set of stream correspondence informa- 
tion VET(N) is multiplexed with the value a Ox0083 B as 
their PID and a value equal to the image data identifier 
VEJd as their table_id_extension. Here, one set of 
stream correspondence information VET(N) is multi- 
plexed for each set of image data VE(N). The sixty-three 
sets of navigation information NE(0) to NE(62) are mul- 
tiplexed having been given the value "0x0082" as their 
PID and a value equal to the navigation element identi- 
fier NE_id as their tablejd_extension. Here, the PCR, 



10 

PAT, and PMTare also multiplexed with predetermined 
values of the PID. 

Here, the table jd_extens ion and streamjd are 
identifiers which are used in conjunction with the PID to 
5 identify the various sets of data. 

With the stated data construction, the data recep- 
tion apparatus 1 21 can set these identifiers into the filter 
condition storage unit 131 as indicated by the received 
data, so that the TS decoder unit 123 can separate the 
10 desired data from the transmitted transport stream. 

Since the VEJd identifier of the image data and the 
NEjd identifier of the navigation information are given 
in the hyperlink information in the navigation information 
corresponding to the content presently being displayed 
to enable the execution of hyperlinks in accordance with 
user operations, it is possible to separate the data com- 
posing the next content to be displayed based on the 
hyperlink information and so display the next content. 
This procedure is described in more detail below. 

First, the data reception apparatus 121 obtains the 
PAT of the transponder (satellite broadcasting unit) 
presently being received. Here, when the program se- 
lected by the user is on a different transponder, the data 
reception apparatus 121 obtains the NIT, refers to the 
NIT, and controls the reception unit 1^2 to change the 
received transponder, although such case will not be de- 
scribed here. [ 

Since the PID of the PAT is set beforehand at "0", 
the data reception apparatus 121 sets n PID=0" into the 
filter condition storage unit 131 so as to separate the 
PAT Since the PID of the PMT is given in the PAT, the 
data reception apparatus 121 can obtain the PID of the 
PMT corresponding to the program and, by setting this 
into the filter condition storage unit 131, separate the 
PMT. 

The PI Ds corresponding to the components are giv- 
en in the PMT, so that the data reception apparatus 1 21 
can obtain the PID of the stream correspondence table 
VET, and, by setting the VEJd obtained from the hyper- 
link information together with the table Jd_extens ion in- 
to the filter condition storage unit 1 31 , the stream cor- 
respondence table VET corresponding to the desired 
image data can be obtained. 

The component Jag and stream Jd are given in the 
stream correspondence table VET, so that the data re- 
ception apparatus 121 can refer to the PMT based on 
the componentjag and obtain the PID of the appropri- 
ate component. By setting this PID and the streamjd 
in the filter condition storage unit 1 31 , the data reception 
apparatus 121 can obtain and display the desired image 
data. 

The data reception apparatus 121 is also able to 
obtain the PID of the component used for multiplexing 
the navigation information by referring to the PMT, and 
by setting the NEJd obtained from the hyperlink infor- 
mation with the tableJd_extension in the filter condition 
storage unit 131, can separate the desired navigation 
information. 
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As a result of the described procedure, the data re- 
ception apparatus 121 can obtain the image data and 
navigation information which compose the new content. 

The following is a more detailed explanation of the 
data construction of the navigation information, using 
the example of the navigation information 216 which is 
given in outline in Fig. 3. The data construction of this 
navigation information 216 is shown in Fig. 6. 

The navigation information 216 includes a 
Bytecode_Part 301, a Handler_Part 302, a Graphics. 
Property_Part 303, a BitmapJnformation_Part 304, 
and a Hyperlink Jnformation_Part 305. 

The Bytecode Part 301 is equivalent to the part of 
Fig. 3 represented by the word "Script", and is used to 
record bytecodes which are one kind of script. These 
bytecodes include an instruction set, such as conditional 
branches, integer calculations, and access to constants/ 
variables, which allows basic programming, and to a va- 
riety of instruction sets that are related to the control of 
image and audio data. 

In the example in Fig. 6, the bytecode with bytecode 
number n 0° is "Push L0, GotoPage". Here, "Push L0" is 
an instruction which represents the storing of the value 
"0" in the stack, while "GotoPage" is an instruction indi- 
cating a switch of display to the content shown by the 
link number whose value is stored in the stack. Here, 
the link number is given in the Hyperlink_ 
lnformation_Part 305, and is an identifier for identifying 
a content to be switched to. Accordingly, the bytecode 
with the bytecode number °0 M describes an operation 
switching the display to the link destination content giv- 
en by link number "0". In the same way, the bytecode 
with the bytecode number n 1 B describes an operation 
switching the display to the link destination content giv- 
en by link number "1". 

The Handler_Part 302 is used to record the corre- 
spondence between handler numbers and bytecode 
numbers. In the example in Fig. 6, the handler numbers 
0 and 1 respectively correspond to the bytecode num- 
bers 0 and 1 . It should be noted here that not only byte- 
codes, but also information defining the processing en- 
vironment of handlers, such as variable areas, is given 
corresponding to the handlers. 

The Bitmap_lnformation_Part 304 is the part used 
to record the content of the bitmaps which display but- 
tons corresponding to the graphics numbers. In the ex- 
ample in Fig. 6, the graphics with the number "0" repre- 
sent the bitmap "Video", while the graphics with the 
number "1" represent the bitmap "Stereo". 

The Graph ics_Property_Part 303 is information for 
composing the on-screen display graphics to be dis- 
played superimposed onto the video data on the display 
screen, and so includes graphics numbers for identify- 
ing sets of graphics, graphics types, display coordinates 
for sets of graphics, a handler number associated with 
the graphics, and an entry showing the initial state for 
when the content is displayed. For the example in Fig. 
6, the type for each set of graphics is "button", with 



graphics numbers 0 and 1 corresponding to the graphics 
in the BitmapJnformation_Part 304 with the same val- 
ues "0" and "1 ". Hereinafter, the button with the graphics 
number "n" will be referred to as "button n° or the "nth 
5 button". In the present example, button 0 and button 1 
are displayed with the x and y coordinates given as 
(20,20) and (20,60), with the handler numbers of the 
handlers which are activated on selection of the buttons 
0 and 1 being "O" and "1 ". Also, the initial state of button 

10 o and button 1 when the content is displayed is "visible". 
The Hyperlink_lnformation_Part 305 is used to 
record the IDs of the materials which compose the link 
destination contents. This Hyperlink_lnformation_Part 
305 records the IDs as the information showing all of the 

*s link destination contents of the content which includes 
this navigation information. Here, link numbers are giv- 
en to identify the sets of identifiers for the link destina- 
tions of each content. For the example in Fig. 6, 
NE_id=1, VE_id=1 are recorded for the link destination 

20 with the link number "0", with this indicating a link des- 
tination content composed of the information in the NE 
with the ID number "1" and the VE with the ID number 
n 1 ". The NEJd=2, VE_id=2are recorded for the linkdes- 
tination with the link number "1", with this indicating a 

25 link destination content composed of the information in 
the NE with the ID number "2" and the VE with the ID 
number "2". j 

It should be noted here that NE_id given as °0" at 
the top of Fig. 6 shows that the navigation information 

30 being explained here is the navigation element which 
has the ID n 0". 

In the data reception apparatus 121, the reception 
control unit 126 refers to the navigation information com- 
posed of the data described above and displays the but- 

35 ton "Video" and the button "Stereo" shown in content 
210 of Fig. 2. When these buttons are selected and ac- 
tivated by the user, control js performed to switch the 
display to another content. 

When a content is displayed, the reception control 

40 unit 126 refers to the Graph ics_Property_Part and dis- 
plays the graphics in order starting from the graphics 
with the graphics number "0" in the indicated initial state 
at the indicated coordinates. When a button is selected 
and activated by the user, the reception control unit 126 

45 executes the handler process corresponding to the han- 
dler number given in the Graphics_Property_Part. This 
handler processing is performed by the reception con- 
trol unit 1 26 referring to the Handler_Part and executing 
the bytecode in the Bytecode_Part which has the byte- 

50 code number given corresponding to the handler 
number in the Handler_Part. It should be noted that this 
execution of bytecodes is achieved by a bytecode inter- 
preter (not illustrated) in the reception control unit 126 
separating and executing one instruction at a time. 

55 In the digital broadcasting system described above, 
the data, such as the image data and navigation infor- 
mation, necessary for displaying each content is repeat- 
edly multiplexed and transmitted by the data transmis- 
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sion apparatus. The data reception apparatus which re- 
ceives this data is able to separate data from the trans- 
mitted data in accordance with selection and activation 
operations made by the user, so that a desired content 
can be displayed. By doing so, an interactive service can 
be achieved using a one-directional broadcast. 

In current broadcasting, there are cases where a 
broadcast of a same program is repeated several days 
later, and to reduce production cost and effort, there are 
demands for the data used to compose a program to be 
used once again in exactly the same form. 

When considering the above demands, a broadcast 
which includes image data with a content such as "Cam- 
paign valid until September 1 0, 1 996" may be broadcast 
as it is until September 10, 1996. When September 11, 
1996 is reached, however, it becomes unsuitable to 
broadcast the data as it is. In this way, there can be cas- 
es where a program will contain data which is not suit- 
able for a repeat broadcast, so that it is necessary to 
develop a system where control is perform in accord- 
ance with the time of broadcast to prevent links to data 
unsuitable for repeat broadcasting being activated. 

It is also common in the world of broadcasting for a 
variety of different programs to be broadcast at different 
times, so that there are demands for the dynamic setting 
of links between programs with different broadcasting 
times so as to link the various programs. In order to sat- 
isfy these demands, it is necessary to have a construc- 
tion which performs control in accordance with the end- 
ing times of programs which are link destinations. 

In the above digital broadcasting system, it is nec- 
essary to have a control structure for programs which 
include a time element. By doing so, program producers 
can efficiently generate and broadcast a great variety of 
programs, with the viewers being able to enjoy a wider 
variety of interactive programs. 

In order to satisfy the need for the above kind of 
program service, it is necessary to perform program 
control with a time element for the system described 
here as the related art. 

SUMMARY OF THE INVENTION 

To satisfy the need for the kind of service described 
above within the framework of the related art, it is a first 
object of the present invention to provide a data display 
control apparatus that has a control mechanism for pro- 
grams that include a time element. This data display 
control apparatus is an apparatus that can receive data 
transmitted by a data transmission apparatus and can 
display data in accordance with user operations. 

It is a second object of the present invention to pro- 
vide a data transmission apparatus that can transmit da- 
ta that enables the realization of a control mechanism 
for programs that include a time element. 

It is a third object of the present invention to provide 
a data display control information editing apparatus that 
edits control information for realizing a control mecha- 



nism for programs that include a time element. 

The first object of the present invention can be 
achieved by a data display control apparatus for receiv- 
ing a plurality of sets of multimedia data and a set of 
5 time control information, and for controlling the display 
of the sets of multimedia data, the plurality of sets of 
multimedia data composing a plurality of contents which 
make up a broadcast program, and the set of time con- 
trol information being used for controlling a display of 

10 the sets of multimedia data, the data display control ap- 
paratus including: a data storage unit; a receiving unit 
for extracting at least one set of multimedia data and the 
set of time control information from data transmitted 
from a broadcast program transmission apparatus and 

is storing the received sets of .multimedia data and the set 
of time control information into the data storage unit; a 
current time information obtaining unit for obtaining a 
set of current time information including an expression 
of a current time; a time information judging unit forjudg- 
es jng whether control relating to a display of the sets of 
multimedia data is possible by comparing the set of cur- 
rent time information with the set of time control infor- 
mation; and a display control unit for controlling the dis- 
play of the sets of multimedia data based on a judging 

25 result of the time information judging ijhit. 

With the stated construction, it is possible to realize 
a data display control apparatus where the time infor- 
mation used for control is compared with the current 
time to see whether control should be performed for the 

30 display of multimedia data, so that display of data can 
be executed where time as a condition. 

Here, the set of time control information may be re- 
peatedly transmitted by the broadcast program trans- 
mission apparatus. 

35 With the stated construction, it is possible to realize 
a data display control apparatus that is able to soon ob- 
tain the time information used for controlling a content, 
when, at an arbitrary time, the user tries to have a con- 
tent displayed by making an operation indicating a link 

40 destination. 

Here, the data display control apparatus may also 
include: a link instruction receiving unit for receiving an 
instruction input by a user which specifies a new content 
to be displayed; and a link instruction executing unit for 

45 displaying the new content according to the instruction 
received by the link instruction receiving unit. 

With the stated construction, it is possible to realize 
a data display control apparatus that enables the user 
to perform interactive operations for the display of con- 

50 tents. 

Here, the receiving unit may also extract the set of 
current time information from the data transmitted from 
the broadcast program transmission apparatus, and the 
current time information obtaining unit may obtain the 
55 current time information from the receiving unit. 

With the stated construction, since the time infor- 
mation is obtained by extracting it from the transmitted 
data, the timing at which operations are made for the 
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display of multimedia data will be the same as the timing 
intended by the producer of the program. 

Here, the data storage unit may store a time differ- 
ence value which indicates a time difference between 
the expression of the current time in the set of current 
time information and a standard control time in the set 
of time control information, and the control judging unit 
may refer to the time difference value and correct a con- 
tent of the current time information using the time differ- 
ence when comparing the set of current time information 
with the set of time control information. 

With the stated construction, it is possible to realize 
a data display control apparatus that can execute oper- 
ations for the display of multimedia data at almost the 
same timing as intended by the producer of the program, 
even when there is a time difference between the cur- 
rent time and the time in the time control information for 
controlling the display of multimedia data. 

Here, the receiving unit may extract the time differ- 
ence value and the set of current time information from 
the data transmitted from the broadcast program trans- 
mission apparatus and storing the extracted time differ- 
ence value in the data storage unit, and the current time 
information obtaining unit may obtain the set of the cur- 
rent time information from the receiving unit. 

With the stated construction, it is possible to realize 
a data display control apparatus that can execute oper- 
ations for the display of multimedia data at exactly the 
same timing as intended by the producer of the program, 
even when there is the time difference described above. 

Here, it is also possible to have a data display con- 
trol apparatus for receiving a plurality of sets of multi- 
media data that compose a plurality of contents which 
make up a broadcast prpgram, and for controlling a dis- 
play of the sets of multimedia data, the data display con- 
trol apparatus including: a data storage unit; a receiving 
unit for extracting, from data transmitted from a broad- 
cast program transmission apparatus, the plurality of 
. sets of multimedia dataj at least one instruction for ex- 
ecuting a certain operation, and at least one set of time 
control information for controlling execution of at least 
one related instruction, the receiving unit storing the 
separated sets of multimedia data, instructions, and 
sets of time control information into the data storage 
unit; a current time information obtaining unit for obtain- 
ing a set of current time information including an expres- 
sion of a current time; a time information judging unit for 
judging whether execution of an arbitrary instruction is 
possible by comparing the set of current time informa- 
tion with a set of time control information related to the 
arbitrary instruction; a display control unit for executing 
the arbitrary instruction based on a judging result of the 
time information judging unit; a link instruction receiving 
unit for receiving an instruction input by a user which 
specifies a content to be displayed; and a link instruction 
executing unit for displaying the content according to the 
instruction received by the link instruction receiving unit. 

With the stated construction, it is possible to realize 



a data display control apparatus that can control wheth- 
er instructions denoting operations should be executed 
based on an indicated time. 

Here, the instructions may be instructions that con- 
s trol a display of the sets of multimedia data. 

With the stated construction, it is possible to realize 
a data display control apparatus that can control the ex- 
ecution for operations relating to the display of multime- 
dia data based on time. 

10 Here, it is also possible to have a data display con- 
trol apparatus for receiving a plurality of sets of multi- 
media data and a plurality of sets of time control infor- 
mation, and for controlling the display of the sets of mul- 
timedia data, the plurality of sets of multimedia data 

*s composing a plurality of contents which are elements of 
a broadcast program, each of the plurality of sets of time 
control information being related to a set of multimedia 
data and being used for controlling a display of the re- 
lated set of multimedia data, the data display control ap- 

20 paratus including; a data storage unit; a receiving unit 
for extracting at least one set of multimedia data and at 
least one set of time control information from data trans- 
mitted from a broadcast program transmission appara- 
tus and for storing the sets of multimedia data and the 

25 sets of time control information into Jhe data storage 
unit; a current time information obtaining unit for obtain- 
ing a set of current time information including an expres- 
sion of a current time; a time information judging unit for 
judging whether control relating to a display of an arbi- 

30 trary set of multimedia data is possible by comparing the 
set of current time information with a set of time control 
information related to the arbitrary set of multimedia da- 
ta; a display control unit for controlling the display of the 
arbitrary set of multimedia data based on a judging re- 

35 suit of the time information judging unit; a link instruction 
receiving unit for receiving an instruction input by a user 
which specifies a content to be displayed; and a link in- 
struction executing unit for displaying the content ac- 
cording to the instruction received by the link instruction 

40 receiving unit. 

With the stated construction, it is possible to realize 
a data display control apparatus that can control display 
of units of multimedia data based on time. 

Here, it is also possible to have a data display con- 

4$ trol apparatus for receiving a plurality of sets of multi- 
media data and a plurality of sets of time control infor- 
mation and controlling display of the sets of multimedia 
data, wherein the plurality of sets of multimedia data 
compose a plurality of contents which make up a broad- 

50 cast program, and each set of time control information 
corresponds one of the plurality of contents, the data 
display control apparatus including: a data storage unit; 
a receiving unit for extracting at least one set of multi- 
media data and at least one set of time control informa- 

55 tion from data transmitted from a broadcast program 
transmission apparatus and storing the sets of multime- 
dia data and the sets of time control information into the 
data storage unit; a current time information obtaining 
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unit for obtaining a set of current time information includ- 
ing an expression of a current time; a link instruction re- 
ceiving unit for receiving an instruction input by a user 
which specifies a content to be displayed; a link instruc- 
tion executing unit for displaying the content according 
to the instruction received by the link instruction receiv- 
ing unit; a time information judging unit forjudging, when 
the link instruction executing unit displays the content, 
whether control relating to a display of the content is 
possible by comparing the set of current time informa- 
tion with a set of time control information related to the 
displayed content; and a display control unit for control- 
ling the display of the content based on a judging result 
of the time information judging unit. 

With the stated construction, it is possible to realize 
a data display control apparatus that performs control 
of display for content units based on time. 

Here, it is also possible to have a data display con- 
trol apparatus for receiving a plurality of sets of multi- 
media data, at least one instruction, and one set of time 
control information related to each instruction, and for 
controlling display of the sets of multimedia data by ex- 
ecuting the instructions, wherein the plurality of sets of 
multimedia data compose a plurality of contents which 
make up a broadcast program, and wherein each set of 
time control information is used for controlling execution 
of the related instruction, the data display control appa- 
ratus including: a data storage unit; a receiving unit for 
extracting at least one set of multimedia data, at least 
one instruction, and at least one set of time control in-' 
formation from data transmitted from a broadcast pro- 
gram transmission apparatus and storing the received 
sets of multimedia data, the received instructions, and 
received sets of time control information into the data 
storage unit; a current time information obtaining unit for 
obtaining a set of current time information including an 
expression of a current time; a time information judging 
unit for judging whether an execution of an arbitrary in- 
struction is possible by comparing the set of current time 
information with a set of time control information related 
to the arbitrary instruction; a display control unit for ex- 
ecuting the arbitrary instruction based on a judging re- 
sult of the time information judging unit; a link instruction 
receiving unit for receiving an instruction input by a user 
which specifies a content to be displayed; and a link in- 
struction executing unit for displaying the content ac- 
cording to the instruction received by the link instruction 
receiving unit 

With the stated construction, it is possible to realize 
a data display control apparatus that automatically per- 
forms display at a predetermined time. 

Here, the sets of time control information may also 
be related to the contents, and the display control unit 
may execute the arbitrary instruction when a content re- 
lated to the set of time control information compared by 
the time information judging unit is being displayed. 

With the stated construction, it is possible to realize 
a data display control apparatus that executes a speci- 
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fied operation such as the display of multimedia data 
only when a specified content is presently being dis- 
played. 

Here, each set of time control information may indi- 
5 cate an absolute control time and the set of current time 
information includes an absolute current time as the ex- 
pression of a current time, and the time information judg- 
ing unit may judge that execution of the arbitrary instruc- 
tion is possible when the control time is equal to or ear- 
10 lier than the absolute current time. 

With the stated construction, it is possible to realize 
a data display control apparatus that can perform the 
display of multimedia data once a predetermined time 
period has elapsed, but will not display the data before 
*5 this predetermined time period has elapsed. 

Here, each set of time control information may indi- 
cate a control elapsed time and the set of current time 
information indicates an elapsed time from a start of a 
display of a current content as the expression of a cur- 
rent time, and the time information judging unit may 
judge that execution of the arbitrary instruction is possi- 
ble when the elapsed time is equal to or greater than the 
control elapsed time in a set of time control information 
for the arbitrary instruction. 

With the stated construction, it is possible to realize 
a data display control apparatus that can perform the 
display of multimedia data once a predetermined time 
period has elapsed from the start of display of a content. 

Here, it is also possible to have a data display con- 
trol apparatus for receiving a plurality of sets of multi- 
media data, at least one instruction, and at least one set 
of time control information, and for controlling display of 
the sets of multimedia data, wherein the plurality of sets 
of multimedia data compose a plurality of contents 
which make up a broadcast program, wherein the in- 
structions are used to control a display of the sets of 
multimedia data, and wherein each set of time control 
information is used for controlling execution of a related 
instruction and is also related to a grouping of sets of 
multimedia data, the data display control apparatus in- 
cluding: a data storage unit; a receiving unit for extract- 
ing, from data transmitted from a broadcast program 
transmission apparatus, at least one set of multimedia 
data, at least one instruction, at least one set of time 
control information, and a set of identification informa- 
tion for a grouping of sets of multimedia data, and for 
storing the sets of multimedia data, the received instruc- 
tions, the received set of time control information, and 
the received set of identification information into the data 
storage unit; a current time information obtaining unit for 
obtaining a set of current time information for a current 
time; a time information judging unit forjudging whether 
execution of an arbitrary instruction is possible by com- 
paring the set of current time information with a set of 
time control information related to the arbitrary instruc- 
tion; a display control unit for referring to the received 
set of identification information, and, when a set of mul- 
timedia data belonging to the grouping of sets of multi- 
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media data identified by the set of identification informa- 
tion is being displayed, executing the arbitrary instruc- 
tion based on a judging result of the time information 
judging unit; a link instruction receiving unit for receiving 
an instruction input by a user which specifies a content 
to be displayed; and a link instruction executing unit for 
displaying the content according to the instruction re- 
ceived by the link instruction receiving unit. 

With the stated construction, it is possible to realize 
a data display control apparatus that can execute a 
specified operation only when specified multimedia data 
is presently being displayed. 

Here, it is also possible to have a data display con- 
trol apparatus for receiving a plurality of sets of multi- 
media data, at least one instruction, and at least one set 
of time control information, and controlling a display of 
the sets of multimedia data according to an operation 
indication input by a user, wherein the plurality of sets 
of multimedia data compose a plurality of contents 
which make up a broadcast program, the instructions 
control a display of the sets of multimedia data, and each 
set of time control information relates to an execution of 
an instruction, the data display control apparatus includ- 
ing: a data storage unit; a receiving unit for extracting at 
least one set of multimedia data, at least one instruction, 
and at least one set of time control information from data 
transmitted from a broadcast program transmission ap- 
paratus and storing the received sets of multimedia da- 
ta, the received instructions, and the received sets of 
time control information into the data storage unit; a cur- 
rent time information obtaining unit for obtaining a set 
of current time information for a current time; an opera- 
tion indication receiving unit for receiving the operation 
indication input by the user; a time information judging 
unit forjudging, when the operation indication receiving 
unit receives the operation indication, whether execu- 
tion of an arbitrary instruction is possible by comparing 
the set of time control information related to the arbitrary 
instruction with the set of current time information; and 
a display control unit for executing the arbitrary instruc- 
tion based on the judging result of the time information 
judging unit. 

With the stated construction, it is possible to realize 
a data display control apparatus that can execute a 
specified operation in response to a user operation only 
after judging from a time element that execution should 
be performed. 

The second object of the present invention can be 
achieved by a data transmission apparatus for transmit- 
ting a plurality of sets of multimedia data, wherein the 
plurality of sets of multimedia data compose a plurality 
of contents which make up a broadcast program, the 
data transmission apparatus including; a transmission 
data storage unit for storing the plurality of sets of mul- 
timedia data and a set of time control information used 
for controlling display of the plurality of sets of multime- 
dia data; and a transmission unit for transmitting the plu- 
rality of sets of multimedia data and the set of time con- 



trol information. 

With the stated construction, it is possible to realize 
a data transmission apparatus that can transmit to a da- 
ta display control apparatus sets of information indicat- 
5 ing a display timing of multimedia data which composes 
a program, the program being a one-direct iona I ly trans- 
mitted program that allows interactive operations to be 
made. 

Here, the transmission unit may repeatedly transmit 
10 the set of time control information. 

With the stated construction, it is possible to realize 
a data transmission apparatus that transmits data so 
that a data display control apparatus can soon obtain 
time information used for control of a content, when a 
15 content which has been selected as a link destination at 
an arbitrary time by a user is to be displayed. 

Here, the transmission data storage unit may fur- 
ther store a set of link information which shows interre- 
lations between contents in the plurality of contents, and 
the transmission unit may also transmit the set of link 
information. 

With the stated construction, it is possible to realize 
a data transmission apparatus which transmits data that 
enables interactive operations to be made by the user 
for the display of contents. f 

Here, the data transmission apparatus of Claim 17 
also include: a time measuring unit for Pleasuring a cur- 
rent time, wherein the transmission unit further transmits 
a set of current time information showing the current 
time. 

With the stated construction, it is possible to realize 
a data transmission apparatus which transmits data that 
enables control of the timing of display of multimedia da- 
ta according to time information which is correct for the 
data display control apparatus. 

Here, the transmission data storage unit may store 
a time difference value which indicates a time difference 
between the current time and a standard control time in 
the set of time control information, and the transmission 
unit may further transmit the time difference value. 

With the stated construction, it is possible to realize 
a data transmission apparatus which transmits data that 
displays multimedia data at the correct timing, even 
when there is a time difference between the standard 
times of the control information for controlling the display 
of multimedia data and the present time. 

Here, it is also possible to have a data transmission 
apparatus for transmitting a plurality of sets of multime- 
dia data, wherein the plurality of sets of multimedia data 
compose a plurality of contents which make up a broad- 
cast program, the data transmission apparatus includ- 
ing: a transmission data storage unit for storing the plu- 
rality of sets of multimedia data, at least one instruction 
for executing a certain operation, at least one set of time 
control information for controlling an execution of a re- 
lated instruction, and a set of link information which 
shows interrelations between contents in the plurality of 
contents; and a transmission unit for transmitting the 
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plurality of sets of multimedia data, the instructions, the 
sets of time control information, and the set of link infor- 
mation. 

With the stated construction, it is possible to realize 
a data transmission apparatus which transmits data for s 
executing specified operations at a given time. 

Here, each of the instructions may control a display 
of a set of multimedia data. 

With the stated construction, it is possible to realize 
a data transmission apparatus which transmits data for 10 
enabling control of operation executions relating to the 
display of multimedia data according to time. 

Here, it is also possible to have a data transmission 
apparatus for transmitting a plurality of sets of multime- 
dia data, wherein the plurality of sets of multimedia data is 
compose a plurality of contents which make up a broad- 
cast program, the data transmission apparatus includ- 
ing: a transmission data storage unit for storing the plu- 
rality of sets of multimedia data, a plurality of sets of time 
control information that each correspond to one set of 20 
multimedia data and are used to control a display of a 
corresponding set of multimedia data, and a set of link 
information which shows interrelations between con- 
tents in the plurality of contents; and a transmission unit 
for transmitting the plurality of sets of multimedia data, 25 
the plurality of sets of time control information, and the 
set of link information. 

With the stated construction, it is possible to realize 
a data transmission apparatus that allows a data display 
control apparatus to control display of multimedia data 30 
units based on time. 

Here, it is also possible to have a data transmission 
apparatus for transmitting a plurality of sets of multime- 
dia data, wherein the plurality of sets of multimedia data 
compose a plurality of contents which make up a broad- 35 
cast program, the data transmission apparatus includ- 
ing: a transmission data storage unit for storing the plu- 
rality of sets of multimedia data, a plurality of sets of time 
control information that each correspond to one content 
and are used to control a display of a corresponding con- 40 
tent, and a set of link information which shows interre- 
lations between contents in the plurality of contents; and 
a transmission unit for transmitting the plurality of sets 
of multimedia data, the plurality of sets of time control 
information, and the set of link information. 45 

With the stated construction, it is possible to realize 
a data transmission apparatus that allows a data display 
control apparatus to control display of content units 
based on time. 

Here, it is also possible to have a data transmission so 
apparatus for transmitting a plurality of sets of multime- 
dia data, wherein the plurality of sets of multimedia data 
compose a plurality of contents which make up a broad- 
cast program, the data transmission apparatus includ- 
ing: a transmission data storage unit for storing, the plu- 55 
rality of sets of multimedia data, at least one instruction 
for controlling display of the sets of multimedia data, at 
least one set of time control information for automatically 



starting an execution of a related instruction; and a set 
of link information which shows interrelations between 
contents in the plurality of contents; and a transmission 
unit for transmitting the plurality of sets of multimedia 
data, the instructions, the sets of time control informa- 
tion, and the set of link information. 

With the stated construction, it is possible to realize 
a data transmission apparatus that has a data display 
control apparatus automatically perform display control 
at a predetermined time. 

Here, each set of time control information may indi- 
cate a control time which is an indicated time. 

With the stated construction, it is possible to realize 
a data transmission apparatus that transmits programs 
for which instructions for operations such as the display 
of multimedia data are executed or not depending on 
time. 

Here, each set of time control information may indi- 
cate a control elapsed time showing an elapsed time 
from a start of display of a predetermined content. 

With the stated construction, it is possible to realize 
a data transmission apparatus that transmits data which 
enables a data display control apparatus to perform the 
display of multimedia data a predetermined time after 
displaying a predetermined content. {' 

Here, it is also possible to have a data transmission 
apparatus for transmitting a plurality offsets of multime- 
dia data, wherein the plurality of sets of multimedia data 
compose a plurality of contents which make up a broad- 
cast program, the data transmission apparatus includ- 
ing: a transmission data storage unit for storing the plu- 
rality of sets of multimedia data, at least one instruction 
for controlling a display of the sets of multimedia data, 
at least one set of time control information, and a set of 
link information which shows interrelations between 
contents in the plurality of contents, wherein each set of 
time control information is composed of time information 
for an automatic start of execution of one of the instruc- 
tions and is related to a grouping of sets of multimedia 
data; and a transmission unit for transmitting the plural- 
ity of sets of multimedia data, the instructions, the sets 
of time information, and the set of link information. 

With the stated construction, it is possible to realize 
a data transmission apparatus that enables a data dis- 
play control apparatus to perform specified operations 
only when a specified set of multimedia is currently be- 
ing displayed. 

Here, it is also possible to have a data transmission 
apparatus for transmitting a plurality of sets of multime- 
dia data, wherein the plurality of sets of multimedia data 
compose a plurality of contents which make up a broad- 
cast program, the data transmission apparatus includ- 
ing: a transmission data storage unit for storing the plu- 
rality of sets of multimedia data, at least one instruction 
for controlling a display of the sets of multimedia data, 
at least one set of time control information which is used 
as a criterion by a reception apparatus in judging wheth- 
er to execute a related instruction; and a set of link in- 
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formation which shows interrelations between contents 
in the plurality of contents; and a transmission unit for 
transmitting the plurality of sets of multimedia data, the 
instructions, the sets of time control information, and the 
set of link information. s 

With the stated construction, it is possible to realize 
a data transmission apparatus that enables a data dis- 
play control apparatus to perform specified operations 
in response to user operations based on the time at- 
which the user operations are made. to 

The third object of the present invention can be 
achieved by a data display control information editing 
apparatus for displaying interrelations between a plural- 
ity of contents on a display screen and for editing, in 
accordance with a user operation, sets of time-related is 
information that are used for controlling the interrela- 
tions, the data display control information editing appa- 
ratus including: a data storage unit for storing a plurality 
of pairings of a set of link information and a set of valid 
period information and storing a set of content control 20 
information, wherein each set of link information indi- 
cates a change in display from a first content to a second 
content, each set of valid period information indicates a 
valid period of a corresponding set of link information, 
and the set of content control information is used for con- 25 
trolling display and processing of contents; a time re- 
ceiving unit for receiving an indicated time input by a 
user; and a content relation displaying unit for displaying 
interrelations between contents at the indicated time re- 
ceived by the time receiving unit, based on the pairings 30 
of a set of link information and a set of valid period in- 
formation which has a valid period that includes the in- 
dicated time received by the time receiving unit. 

With the stated construction, it is possible to realize 
a data display control information editing apparatus that 35 
allows the user to understand the links between con- 
tents at a glance, and allows the user to see what links 
are valid at a time indicated by the user. 

Here, the data display control information editing 
apparatus may also include: a content specification re- 40 
ceiving unit for receiving a specification of a content in- 
put by a user; and a link information updating unit for 
updating a set of valid period information of a set of link 
information which indicates a change in display to the 
content specified by the user so that the set of link in- 45 
formation is made invalid at the indicated time received 
by the time receiving unit. 

With the stated construction, it is possible to realize 
a data display control information editing apparatus 
which generates control information that prevents the so 
display of an indicated content after a time indicated by 
the user by severing a link from a content to the indicated 
content. 

Here, the sets of link information and the sets of val- 
id period information are transmitted from a transmis- ss 
sion apparatus used in a digital broadcast system to a 
data display control apparatus which displays contents. 

With the stated construction, it is possible to realize 



a data display control information editing apparatus 
which generates control information that has a specified 
operation executed at a specified time by a data display 
control information editing apparatus that receives a dig- 
ital broadcast. 

BRIEF DESCRIPTION OF THE INVENTION 

These and other objects, advantages and features 
of the invention will become apparent from the following 
description thereof taken in conjunction with the accom- 
panying drawings which illustrate a specific embodi- 
ment of the invention. In the drawings: 

Fig. 1 shows the construction of a digital broadcast- 
ing system of the related art; 
Fig. 2 shows an example of images displayed by 
the data reception apparatus in the digital broad- 
casting system of the related art; 
Fig. 3 is a simplified representation of the data 
transmitted by the data transmission apparatus of 
the related art; 

Fig. 4 is a more detailed representation of the data 

transmitted by the data transmission apparatus of 

the related art; | 

Fig. 5 shows the multiplexing of the data transmitted 

by the data transmission apparatus in the related 

art; 

Fig. 6 shows the data construction of the navigation 
information 216 in the related art; 
Fig. 7 is a block diagram showing the construction 
of the data display control apparatus in the first em- 
bodiment of the present invention; 
Fig. 8 shows examples of images displayed by the 
data display control apparatus 1 000 in the first em- 
bodiment of the present invention; 
Fig. 9 is a simplified representation of the data 
transmitted by the data transmission apparatus; 
Fig. 1 0 is a more detailed representation of the data 
transmitted by the data transmission apparatus 
Fig. 11 shows the data construction of the naviga- 
tion information 21 60; 

Fig. 1 2 shows the data construction of the naviga- 
tion information 2260; 

Fig. 1 3 shows the data construction of the naviga- 
tion information 2360; 

Fig. 14 is a flowchart for a content switching oper- 
ation and the activation of a handler; 
Fig. 15 shows the transformation in the display 
screen; 

Fig. 1 6 A shows the data construction of the TDT; 
Fig. 1 6B shows the data construction of the TOT; 
Fig. 17 shows the data construction of the naviga- 
tion information 2170; 

Fig. 1 8 shows the data construction of the naviga- 
tion information 2270; 

Fig. 1 9 shows the data construction of the naviga- 
tion information 2370; 
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Fig. 20 is a flowchart for the operation for the acti- 
vation of a handler in the second embodiment; 
Fig. 21 shows the transformation in the display 
screen in the second embodiment; 
Fig. 22 shows the data construction of the naviga- 5 
tion information 2180; 

Fig. 23 is a flowchart showing a content switching 
operation and the activation of a handler in the third 
embodiment; 

Fig. 24 shows the data construction of the naviga- io 
tion information 6160; 

Fig. 25 is a flowchart showing a content switching 
operation and the activation of a handler in the 
fourth embodiment; 

Fig. 26 shows the changes in the display screen in is 
the fourth embodiment; 

Fig. 27 shows the data construction of the naviga- 
tion information 7160; 

Fig. 28 is a flowchart showing a content switching 
operation and the activation of a handler in the fifth 20 
embodiment; 

Fig. 29 shows examples of images displayed by the 
data display control apparatus 1000 in the sixth em- 
bodiment of the present invention; 
Fig. 30 is a simplified representation of the data 25 
transmitted by the data transmission apparatus; 
Fig. 31 shows the data construction of the naviga- 
tion information 8160; 

Fig. 32 is a flowchart showing a content switching 
operation and the activation of a handler; 30 
Fig. 33A shows the transformation in the display 
screen when the user gives his/her answer within 
the time limit of a quiz; 

Fig. 33B shows the transformation in the display 
screen when the user does not give his/her answer 35 
within the time limit of a quiz; 
Fig. 34 is a block diagram showing the construction 
of the data display control information editing appa- 
ratus of the seventh embodiment of the present in- 
vention; 40 
Fig. 35 is a flowchart showing the operation of the 
data display control information editing apparatus 
10000; 

Fig. 36 shows an example display for the display 
screen of the data display control information edit- 45 
ing apparatus 10000; 

Fig. 37 is a block diagram showing the construction 
of the data display control information editing appa- 
ratus in the eighth embodiment of the present in- 
vention; and so 
Fig. 38 is a flowchart showing the operation of the 
data display control information editing apparatus 
10500 in the eighth embodiment. 

55 



DESCRIPTION OF THE PREFERRED 
EMBODIMENTS . 

First Embodiment 

The first embodiment of the present invention re- 
lates to a data transmission apparatus that broadcasts 
programs for which specified operations can be per- 
formed at a specified time, and to a data display control 
apparatus which receives transmitted data and per- 
forms the specified operations at indicated times. This 
first embodiment of the present invention is described 
in detail below, with reference to the drawings. 

The data display control apparatus of the first em- ' 
bodiment of the present invention is an apparatus which 
receives an MPEG2 transport stream transmitted by a 
transmission apparatus for a digital broadcast and inter- 
actively separates and reproduces contents from the 
MPEG2 transport stream in accordance with user oper- 
ations. 

The term "content- is used to express the unit of 
information for which interactive operations can be per- 
formed by the user. Here, each content is composed of 
presentation information and navigation information. 
The presentation information is composed of image da- 
ta and audio data. The navigation information is com- 
posed of bitmap data for buttons that ire used to com- 
pose on-screen display graphics that are displayed su- 
perimposed onto the various kinds of image data, scripts 
that represent the operation processing to be performed 
in response to user operations, and hyperlinks that ex- 
press the contents for the link destinations to which the 
display can be switched in accordance with user oper- 
ations. The transmission data is formed by multiplexing 
the presentation information and navigation information, 
and is repeatedly transmitted by the data transmission 
apparatus in the first embodiment as a MPEG2 transport 
stream in accordance with MPEG2 (Moving Pictures Ex- 
perts Group Phase2) standards. 

It should be noted here that the data transmission 
apparatus in the first embodiment performs transmis- 
sion of at least one MPEG2 transport stream on a variety 
of bandwidths for a same satellite (network), in the same 
way as a conventional digital satellite broadcasting sys- 
tem. Here, all of the broadcast programs are multiplexed 
into the MPEG2 transport streams. 

Construction of the Data Display Control Apparatus 

The following is an explanation of the construction 
of the data display control apparatus in the first embod- 
iment of the present invention. 

The construction of the data display control appa- 
ratus of the first embodiment is shown by the block dia- 
gram in Fig. 7. As shown in the figure, the data display 
control apparatus 1000 is composed of a reception unit 
1010, a TS decoder unit 1020, an AV decoder unit 1030, 
a received data storage unit 1 040, a reception control 
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unit 1050, a reproduction unit 1060, a display unit 1070, 
an audio output unit 1080, and a signal reception unit 
1100. 

The reception unit 1010 receives the MPEG2 trans- 
port stream and outputs it to the TS decoder unit 1020. 
It should be noted here that the indication of the MPEG2 
transport stream is performed using identifiers accord- 
ing to conirol by the reception control unit 1 050. 

The TS decoder unit 1020 includes a filter condition 
storage unit 1021 for storing the filter conditions speci- 
fied by the reception control unit 1050, and operates in 
accordance with these filter conditions so as to on ly sep- 
arate image data or audio data with identifiers indicated 
by the reception control unit 1050 from the transport 
stream outputted by the reception unit 1010. The TS de- 
coder unit 1020 outputs the separated data to the AV 
decoder unit 1030. The TS decoder unit 1020 also sep- 
arates table data with identifiers specified by the recep- 
tion control unit 1050 and outputs the table data to the 
received data storage unit 1040. The TS decoder unit 
1 030 also separates a PCR (Program Clock Reference) 
and outputs it to the AV decoder unit 1030. 

The filter condition storage unit 1021 is capable of 
simultaneously storing a plurality of filter conditions and 
the TS decoder unit 1 020 is capable of performing a plu- 
rality of separations based on the filter conditions in par- 
allel. Here, the term "filter condition" refers to indication 
information, such as the stream IDs and table IDs for 
separating image data, audio data, navigation informa- 
tion, PCRs, and other control information, output desti- 
nations for the separated data, and control information 
which start or stops separation operations. 

The AV decoder unit 1 030 includes a clock unit 1 031 
and an internal buffer, and on receiving image data and/ 
or audio data from the TS decoder unit 1020, stores the 
data in its internal buffer. The AV decoder unit 1030 then 
decodes the image data and/or audio data in the prede- 
termined decoding units in accordance with instructions 
from the reception control unit 1050 and outputs the de- 
coded data to the reproduction unit 1060 in synchroni- 
zation using the clock unit 1031. 

The clock unit 1031 is set at a standard time using 
the value of the PCR outputted by the TS decoder unit 
1020 and is used to measure time that is used as the 
standard to ensure that image data and audio data are 
decoded in synchronization. 

The received data storage unit 1040 can be com- 
posed of RAM, for example, and includes a stream cor- 
respondence storage unit 1041, a navigation informa- 
tion storage unit 1 042, a system information table stor- 
age unit 1 043, and a time information storage unit 1 044. 
It should be noted here that the stream correspondence 
storage unit 1 041 is the same as the stream correspond- 
ence table storage unit 1 32 in the related art, the navi- 
gation information storage unit 1042 is the same as the 
navigation information table storage unit 133, and the^ 
system information storage unit 1043 is the same as the' 
system information table storage unit 134. 



The stream correspondence storage unit 1041 has 
an area for storing information showing the multiplexing 
units in the stream for the images and audio which com- 
pose each content, with this area storing sets of stream 
5 correspondence information VET which are information 
showing the relationship between VE_ids, which are 
identifiers for video elements (VE) which are units of in- 
formation for image data, and multiplexing units for VEs 
in the stream,- Accordingly, the identifier VE_id is used 
10 to specify the image data to be displayed. 

In the same way, the navigation information storage 
unit 1042 has an area for storing navigation information, 
the system information storage unit 1043 has an area 
for storing system information such as the PAT and PMT 
75 and the time information storage unit 1044 has an area 
for storing the TOT and the TDT 

The PAT (Program Association Table) referred to 
here is information for managing a plurality of broadcast 
programs in accordance with MPEG2 system standard. 
The PAT includes PIDs which are identifiers for separat- 
ing a PMT for each program, with the PID of the PAT 
itself being predetermined as "0 n . 

As a result, the data display control apparatus can 
separate the PAT from the transmitted data by setting 
the PID "O" in the filter condition storage unit 1021, with 
the separated PAT being stored in the system informa- 
tion storage unit 1043. I 

The PMT (Program Map Table) is information for 
managing the various kinds of information required by 
one broadcast program in accordance with MPEG2 sys- 
tem standard. The PMT includes the PIDs that are the 
identifiers used for separating the PCR, the image data, 
and navigation information, and identifiers for the image 
data and navigation information of the content which is 
to be displayed first when the present program is select- 
ed. 

When a program is selected by the user of the data 
display control apparatus, the data display control ap- 
paratus refers to the PAT to obtain the PID of the PMT 
corresponding to the selected program and sets this PID 
in the filter condition storage unit 1021 to separate the 
PMT which it then stores in the system information stor- 
age unit 1 043. 

The TDT (Time and Data Table) is information 
showing a standard time for the present date and time, 
while the TOT (Time Offset Table) is information show- 
ing a time difference for different countries. This TDT 
and TOT are described in more detail later in this spec- 
ification. 

The signal reception unit 1100 receives a signal for 
a user operation sent from a remote controller or the like, 
and informs the reception control unit 1050 of the re- 
ceived signal. 

The reproduction unit 1060 superimposes on- 
screen display graphics information outputted by the re- 
ception control unit 1 050 onto the image data decoded 
by the AV decoder unit 1030 in accordance with indica- 
tions from the reception control unit 1 050, and outputs 
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a combined image to the display unit 1070. The repro- 
duction unit 1060 also outputs the audio data decoded 
by the AV decoder unit 1030 to the audio output unit 
1080. 

The display unit 1070 can be realized by a CRT or 
liquid crystal display, and is used to display the images 
outputted by the reproduction unit 1060. 

The audio output unit 1080 can be realized by a 
speaker, and outputs the audio outputted by the repro- 
duction unit 1060. 

The reception control unit 1050 has a bytecode in- 
terpreter 1051 , and controls the reception unit 1010, the 
TS decoder unit 1020, the AV decoder unit 1030, and 
the reproduction unit 1060 to receive the desired trans- 
port stream, to reset the filter conditions in the filter con- 
dition storage unit 1021 for the data to be separated, 
and to reproduce the desired images and audio. The re- 
ception control unit 1 050 also performs a variety of op- 
erations in response to user operations. 

In accordance with a user operation, the reception 
control unit 1050 refers to the navigation information in 
the navigation information storage unit 1042, outputs 
the on-screen display graphics to be displayed super- 
imposed on the image data to the reproduction unit 
1060, and, when a button operation is made by the user, 
executes the corresponding handler processing. Here, 
buttons are displayed on the display screen using these 
on-screen display graphics and are displayed based on 
bitmap information (or the like) given in the navigation 
information. The handler processing referred to here is 
an operation which is executed corresponding to the oc- 
currence of an event, and is performed based on the 
scripts given in the navigation information. 

The bytecode interpreter 1051 interprets the scripts 
given in the navigation information one by one and ex- 
ecutes them. 

Data Composition of the Contents and the Display 
Screen 

The following is an explanation of the display screen 
of the data display control apparatus 1000 which dis- 
plays the contents and of the data which composes each 
content, with reference to Figs. 8, 9, 10, and 11 . 

Fig. 8 shows an example of the screen displayed 
by the data display control apparatus 1000 in the first 
embodiment of the present invention. This figure corre- 
sponds to Fig. 2 of the related art section and shows an 
example of a mail order program. Fig. 8 shows a content 
2100 which displays a mail order menu, a content 2200 
which displays information about video equipment, and 
a content 2300 which displays information about stereo 
equipment. Here, switching is possible between these 
contents 21 00, 2200, and 2300 in accordance with user 
operations, as shown by the arrows 2400, 2410, 2420, 
and 2430. The difference with Fig. 2 is that content 21 30 
is provided as the same content as content 2100 after 
a given time period has passed. 



When the content 2100 representing the mail order 
menu is displayed on the display screen and the user 
selects and activates the "Video" button 2110, the dis- 
play switches as shown by the arrow 2400 from content 
5 2100 to content 2200 which displays information about 
video equipment. If the user then selects and activates 
the "Menu" button 2210, the display switches as shown 
by the arrow 2410 back from the content 2200 to the 
content 2100. 

10 in the same way, when the content 21 00 represent- ' 
ing the mail order menu is displayed on the display 
screen and the user selects and activates the "Stereo" 
button 21 20, the display switches as shown by the arrow 
2430 from content 21 00 to content 2300 which displays 
is information about stereo equipment. If the user then se- 
lects and activates the "Menu" button 2310, the display 
switches as shown by the arrow 2420 back from the con- 
tent 2300 to the content 2100. Here, contents 2100, 
2200, and 2300 are provided with buttons 2110, 2120, 
20 2210, and 2310 to allow the user to make the interactive 
operations which switch the display as described. 

When the time 15:00:00 on September 9, 1996 is 
reached, the display of the content 2100 is changed to 
become displayed as the content 21 30 where the button 
"This offer is no longer valid" is displayed. This button 
21 31 is displayed according to data which is already in- 
cluded as part of content 21 00. \ 

Data Transmission Apparatus 

The following is an explanation of the transmission 
of the data composing each content by the data trans- 
mission apparatus in the digital broadcasting system of 
the first embodiment of the present invention. It should 
be noted here that the data transmission apparatus of 
the first embodiment has the same construction as the 
data transmission apparatus 1 01 (see Fig. 1 ) described 
in the related art section. However, unlike the related 
art, information is included in the transmitted navigation 
information to enable control according to a time ele- 
ment, with the content of this navigation information be- 
ing described later in this specification. 

Fig. 9 is a simplified representation of the data 
transmitted from the data transmission apparatus. This 
figure corresponds to Fig. 3 in the related art section, 
with the transmitted data 2010 corresponding to data 
201 in Fig. 3, the image data 2150, 2250, and 2350 cor- 
responding to image data 215, 225, and 235 in Fig. 3, 
and the navigation information 2160, 2260, and 2360 
corresponding to data 216, 226, and 236 in Fig. 3. 

Each set of image data 2150, 2250, and 2350 rep- 
resents a background image for the contents 2100, 
2200, and 2300 which are displayed on the display 
screen of the data display control apparatus 1000. 

The difference between Fig. 3 and Fig. 9 lies in the 
inclusion of control information called "Time Event" in 
each set of navigation information in Fig. 9. It should 
also be noted here that unlike Fig. 3, the navigation in- 
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formation 2160 in Fig. 9 includes a bitmap for a button 
stating "This offer is no longer valid" which has an at- 
tribute showing that it is invisible in its initial state. 

The content 2100 shown in Fig. 8 is expressed by 
the image data 2150 and the navigation information 5 
2160. Likewise, the content 2200 is expressed by the 
image data 2250 and the navigation information 2260, 
and the content 2300 is expressed by the image data 
2350 and the navigation information 2360. 

The data transmission apparatus repeatedly trans- 10 
mits the data 201 0 in a predetermined cycle. This trans- 
mission is the same as that described in the related art 
section with reference to Fig. 4, with the image data and 
navigation information of Fig. 4 being replaced by the 
image data and navigation information shown in Fig. 9. is 

The following is a detailed explanation of the data 
which is multiplexed and transmitted by the data trans- 
mission apparatus. A representation of the multiplexing 
of the data to be transmitted by the data transmission 
apparatus is shown in Fig. 10. 20 

Fig. 10 corresponds to Fig. 5 of the related art sec- 
tion, so that image data VE(N), navigation information 
NE(N), stream correspondence information VET(N), 
and system information such as a PCR, PAT, and PMTs 
are multiplexed into the transmission data. This system 2s 
information further includes a TDT and TOT which are 
given predetermined PIDs. 

Since the data transmission apparatus of the first 
embodiment transmits the data as described above, the 
data display control apparatus 1 000 can have the TS 30 
decoder unit 1020 separate the TDT and TOT from the 
transmitted transport stream by setting the PIDs which 
are predetermined for the TDT and TOT into the filter 
condition storage unit 1021. 

35 

Detailed Description of the Navigation Information 

The following is an explanation of the navigation in- 
formation which was shown in outline in Fig. 9, with ref- 
erence to Figs. 11 to 13. 40 

Fig. 11 shows the data construction of the naviga- 
tion information 2160. This navigation information 2160 
includes a Time_Event_Part 2161, a Bytecode_Part 
2162, a Handler_Part 2163, a Graphics_Property_Part 
2164, a Bitmap J nformation_Part 2165, and a 45 
HyperlinkJnformation_Part 2166. 

Fig. 11 corresponds to Fig. 5 in the related art sec- 
tion and differs from the related art by including a 
Time_Event_Part 2161 which is characteristic to the 
present invention. so 

The Time_Event_Part 2161 corresponds to the part 
in Fig. 9 shown as "Time_Event" p and is information 
which shows that a specified handler is to be activated 
at an indicated time. In the example in Fig. 11 , the han- 
dler with the handler number "2" is activated at 15:00: ss 
00 on September 9, 1996. It should be noted here'that 
several activation times may be given for a same han- 
dler. In the present example, this activation time is given 



in year, month, day, hour, minute, second order. 

The Bytecode_Part 21 62 corresponds to the part in 
Fig. 9 shown as "Script", and is the information used for 
recording bytecodes which are a kind of script. These 
bytecodes include an instruction set, such as conditional 
branches, integer calculations, and access to constants/ 
variables, which allows basic programming, and a vari- 
ety of instruction sets that are related to the control of 
image and audio data 

In the example in Fig. 11, the bytecode with byte- 
code number "0" is "Push L0, GotoPage". Here, Tush 
L0" is an instruction which represents the storing of the 
value "0" in the stack, while "GotoPage" is an instruction 
indicating a switch of display to the content shown by 
the link number whose value is stored in the stack. Here, 
the link number is given in the 
Hyperlink_lnformation_Part, and is an identifier for iden- 
tifying a content to be switched to. 

The bytecode with bytecode number "2" is "Set- 
GraphicVisibility", with this being an instruction that 
switches between "visible" and "invisible" states de- 
pending on whether "0" or "1" is stored in the stack, 
these states being for a button indicated by a value in 
the stack that precedes the value indicating "visible" or 
"invisible". f 

Accordingly, the bytecode with the bytecode 
number "0" indicates a switching of the display to the 
content which is the link destination for link number "0°, 
while the bytecode with the bytecode number "1" indi- 
cates a switching of the display to the content which is 
the link destination for link number "1". The bytecode 
with the bytecode number "2°, meanwhile, makes the 
button with the graphics number "2" visible, while mak- 
ing the buttons with the graphics numbers "0" and "1" 
invisible. Graphics numbers are dealt with in more detail 
in the description of the Graphics_Property_Part given 
later in this specification. 

The Handler_Part 2163 is the information which 
records the correspondence between handler numbers 
and bytecode numbers. In the example in Fig. 11, han- 
dler numbers 0, 1, and 2 respectively correspond to 
bytecode numbers 0, 1, and 2. It should be noted here 
that not only bytecodes, but also information defining the 
processing environment of handlers, such as variable 
areas, is given corresponding to the handlers, although 
such information is not especially related to the present 
invention and has therefore not been illustrated. 

The Bitmap J nformation_Part 2165 is the part used 
to record the content of the bitmaps which display but- 
tons corresponding to the graphics numbers. In the ex- 
ample in Fig. 11, the graphics with the number "0" rep- 
resent the bitmap "Video", while the graphics with the 
number "1" represent the bitmap "Stereo", and the 
graphics with the number "2" represent the bitmap "This 
offer is no longer valid". 

The Graphics_Property_Part 2164 is information 
for composing the on-screen display graphics to be dis- 
played superimposed onto the video data on the display 



17 



33 



EP0 830 019 A2 



34 



screen, and so includes graphics numbers for identify- 
ing sets of graphics, graphics types, display coordinates 
for sets of graphics, a handler number associated with 
the graphics, and an entry showing the initial state for 
when the content is displayed. For the example in Fig. 5 
11, the type for each set of graphics is "button", with 
graphics numbers 0, 1, and 2 corresponding to the 
graphics in the Bitmap J nformation_Part 2165 with the 
same values "0", "1", and °2". In the present example, 
button 0, button 1, and button 2 are displayed with the 10 
x and y coordinates respectively given as (20,20), 
(20,60), and (0,20). The handler numbers of the han- 
dlers which are activated on selection and activation of 
the buttons 0 and 1 are given as "0" and "1", while no 
handler is given corresponding to button 2. Also, the in- ?5 
itial states of button 0 and button 1 when the content is 
displayed are given as "visible", while the initial state of 
button 2 is given as "invisible". 

The Hyperlink J nformation_Part 2166 is informa- 
tion that records the I Ds of the materials which compose 20 
contents for link destinations. Here, I Ds for materials are 
given as the information showing all of the contents that 
are link destinations for the content to which the present 
navigation information belongs. Here also, linknumbers 
are given to identify the sets of identifiers which identify 25 
each of the link destination contents. For the example 
shown in Fig. 11, "NE_id=1, VE_id=1 a is recorded for 
the link destination with the link number "0", showing 
that the content which is composed of the information 
with the VE_id "1 " and the NEjd "1 " is a link destination. 30 
Here, information is also recorded showing that the con- 
tent which is composed of the information with the VEJd 
"2 n and the NEjd "2" is the link destination for the link 
number "1". 

It should be noted here that NE_id given as "0" at 35 
the top of Fig. 11 shows that the navigation information 
being explained here is the navigation element which 
has the ID "0". 

Fig. 1 2 shows the clata construction of the naviga- 
tion information 2260. The NEjd of this navigation in- 40 
formation is "1 ", and the data construction is the same 
as navigation information 2160 described above. The 
content of this navigation information 2260 in Fig. 1 2 is 
described in detail below. 

The Time_Event_Part 2261 contains no informa- 45 

tion. 

The Bytecode_Part 2262 records that the bytecode 
with the bytecode number "0" is "PushLO, GotoPage", 
which is an example instruction that displays the content 
which is the link destination with the link number "0". so 

The Handler_Part 2263 shows that the handler 
number "0" corresponds to the bytecode number "0°. 

The Bitmap_lnformation_Part 2265 shows that the 
bitmap for "Menu" has been assigned the bitmap 
number "0". ss 

The Graphics_Property_Part 2264 shows that the 
graphics type is "button", and that the graphics number 
is "0°. The x and y coordinates for displaying button 0 



are given as (20,60). The handler which is activated on 
the activation of button 0 is given as handler number 0, 
with the button 0 being visible in the initial state when 
the present content is displayed. 

The Hyperlink_lnformation_Part 2266 records 
"NE_id=0, VE_id=0" as the link destination with the link 
number "0", and so shows that the content which is com- 
posed of the information with the NEjd "0" and the 
VEJd "0" is a link destination. 

Fig. 1 3 shows the data construction of the naviga- 
tion information 2360. The NEJd of this navigation in- 
formation is "2", and the data construction is the same 
as navigation information 2160 described above. The 
content of this navigation information 2360 in Fig. 13 is 
described in detail below. 

The Tim eJE vent J^rt 2361 contains no informa- 
tion. 

The Bytecode_Part 2362 records that the bytecode 
with the bytecode number "0° is "PushLO, GotoPage", 
which is an example instruction that displays the content 
which is the link destination with the link number "0". 

The Handler_Part 2363 shows that the handler 
number "0" corresponds to the bytecode number "0". 

The Bitmap_lnformation_Part 2365 shows that the 
bitmap for "Menu" has been assigped the bitmap 
number "0". ' ( 

The Graphics_Property_Part 2364 shows that the 
graphics type is "button", and that the graphics number 
is "0". The x and y coordinates for displaying button 0 
are given as (20,60). The handler which is activated on 
the activation of button 0 is given as handler number 0, 
with the button 0 being visible in the initial state when 
the present content is displayed. 

The Hyperlink J nformation_Part 2366 records 
NEjd=0, VEJd=0 as the link destination with the link 
number "0", and so shows that the content which is com- 
posed of the information with the NEJd a 0" and the 
VEJd "0" is a link destination. 

Each content is composed of navigation informa- 
tion, with the data composition described above, and im- 
age data, and is displayed on a display screen of a data 
reception apparatus. 

It should be noted here that the image data which 
corresponds to the VEJd=0 is image data 2150, while 
the image data which corresponds to the VE_id=1 is im- 
age data 2250, and the image data which corresponds 
to the VE id=2 is image data 2350 (see Fig. 9). 

Using the data described above, when the user se- 
lects and confirms a button for a content displayed by 
the data display control apparatus 1000, the display 
switches to another content. When the time given in the 
Time_Event_Part is reached, control is also performed 
to execute the specified operation. 

Operation of the Data Display Control Apparatus 

The following is an explanation of the operation of 
the reception control unit 1 050 of the data display control 
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apparatus 1000 based on the data construction de- 
scribed above. This explanation refers to Figs. 14 and 
15. 

Fig. 1 4 is a flowchart showing a content switching 
operation and the activation of a handler, and Fig. 15 5 
shows the transformation in the display screen. 

The reception control unit 1050 is composed of a 
CPU and a program, and performs the processing for 
content switching and the activation of handlers. This 
processing is achieved according to the flow in Fig. 14. 10 
in the initial process in S3010, the content to be dis- 
played at the start of the reception of a program is indi- 
cated. When it is judged in S3020 that a content switch- 
ing operation is to be made, the processes in S3030, 
S3040, and S3050 or S3060 are performed. After this, is 
it is judged in S3070 whether there is a handler to be 
activated at an indicated time, with the processes S3080 
to S3100 being performed in such case. Processes 
S3110 and S3120 are then performed corresponding to 
user inputs, and in S31 30 is performed to activate a han- 20 
dler. 

The information for the first content to be displayed 
is set as a pair of a VE_id and an NE_id in the PMT 
stored in the system information storage unit 1043. The 
following example focuses on the case where the infor- 25 
mation VE_id=0 and NE_id=0 is given in the PMT. The 
explanation also supposes that the present operation 
starts at 14:57:00 on September 9, 1 996. 

First, the information VE_id=0 and NE_id=0 is read 
from the PMT as the information for the first content to 30 
be displayed for the present mail order program (step 
S3010). Since this is the first content, the system con- 
siders that content switching has been performed 
(S3020:Yes) and so displays the present content 
(S3030). 35 

The display of this first content is achieved by dis- 
playing the image data 2150 with the VE_id=0 as the 
background image and on-screen display graphics in 
accordance with the content of the navigation informa- 
tion with the NE_id=0. Here, the button "Video" is visibly 40 
displayed at a position given by the coordinates (20,20) 
and the button "Stereo" is visibly displayed at a position 
given by the coordinates (20,60), in accordance with the 
content of the Graph ics_Property_Part 2164 and the 
BitmapJnformation_Part 2165 of the navigation infor- 45 
mation shown in Fig. 11. This results in the display 
shown as 3210 in Fig. 15. 

Once the present content has been displayed, the 
reception control unit 1050 judges whether there is a 
time indication for activating a handler in the so 
Time_Event_Part of the NE (S3040), in which case the 
time indication flag for handler activation processing in 
response to time is set at "1 " (S3050). When there is no 
time indication, the time indication flag is set at "0" 
(S3060). Here, since the handler with the handler ss 
number "2" in the Time_Event_Part of the navigation in- 
formation shown in Fig. 11 is set as being activated at 
15:00:00 on September 9, 1 996, the time indication flag 



is set at"1" (S3050). 

When the time indication flag has been set at "1" 
(S3070:Yes) ( the reception control unit 1050 obtains the 
present time (S3080) and adjusts the present time using 
the time difference set for the country in which the data 
display control apparatus 1000 is located (S3090). The 
acquisition of the time difference and adjustment of the 
present time are described in more detail later in this 
specification. In the present example, however, there is 
no time difference. 

The reception control unit 1050 judges whether the 
present time has reached the time indicated in the 
Time_Event_Part 2161 of the present navigation infor- 
mation NE (S3100), and if not, advances to the process- 
ing for the movement of the selection pointer in accord- 
ance with user inputs (S3110). When one of the buttons 
has been selected and activated by the user (S3120: 
Yes), the corresponding handler is activated (S31 30). 
The selection pointer referred to here is a mark which is 
displayed on the display screen that can be moved in 
accordance with user operations. As a result, the user 
can move the selection pointer to indicate a desired but- 
ton using cursor keys provided, for example, on a re- 
mote controller, with the indicated button being selected 
and activated when the user presses tyie "Enter" key. 

In the present example, the user selects the "Video" 
button, so that the reception control unit 1050 refers to 
the Graph ics_Property_Part 2164 and activates the 
handler with the handler number "0". This handler is 
composed of the bytecode with the bytecode number 
"0" whose content is "PushLO, GotoPage". As a result, 
the display switches to the content which is the link des- 
tination of the link number "0", with this content being 
expressed by B VE_id=1, NE_id=1 M in the 
Hyperlink_lnformation_Part 2166. Here, bytecodes are 
executed by the reception control unit 1050 using the 
bytecode interpreter 1051. 

The bytecode interpreter 1051 has a stack area for 
storing variables, and in the present case interprets 
"PushLO" and stores the value "0" in the stack area. After 
this, the bytecode interpreter 1051 interprets "GotoP- 
age" and performs content switching for the link number 
corresponding to the value stored in the stack area. 

After the activation of a handler (S3130), the 
processing returns to the judgement of whether content 
switching has been performed (S3020), and since this 
is the case, the new content is displayed (S3030). 

The display of this next content is achieved by dis- 
playing the image data 2250 with the VE_id=1 as the 
background image and on-screen display graphics in 
accordance with the content of the navigation informa- 
tion with the NE_id=1 . Here, the button "Menu" is visibly 
displayed at a position given by the coordinates (20,60), 
in accordance with the content of the 
Graphics_Property_Part 2264 and the 
Bitmap_lnformation_Part 2265 in the navigation infor- 
mation NE shown in Fig. 1 2. 

The time when this next content is displayed is 14: 
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58:00 on September 9, 1 996, so that the display screen 
becomes as shown by 3220 in Fig. 15. 

Atter the content display process has been per- 
formed (S3030), the reception control unit 1050 judges 
whether there is a time indication in the s 
Time_Event_Part of the present NE (S3040). Since the 
Time„Event_Part 2261 of the navigation information NE 
in Fig. 12 does not include any time indications, the re- 
ception control unit 1050 sets the time indication flag at 
"0" (S3060). 10 

Since the time indication flag is "0" (S3070), the re- 
ception control unit 1 050 skips the time judgement proc- 
esses (S3080 to S3100), and performs the processing 
for user inputs (S3110, S3120), with a corresponding 
handler being activated in S31 30 when a button has 1$ 
been selected and activated. 

When the user selects and activates the "Menu" 
button, the reception control unit 1050 refers to the 
Graphics_Property_Part 2264 and activates the handler 
with the handler number "0". This handler is composed 20 
of the bytecode with the bytecode number "0" whose 
content is "PushLO, GotoPage". Asa result, the display 
switches to the content which is the link destination of 
the link number "0", with this content being expressed 
by n VE_id=0, NE_id=0 u in the Hyperlink. 25 
lnformation_Part 2266. 

After the activation of a handler (S3130), the 
processing returns to the judgement of whether content 
switching has been performed (S3020), and since this 
is the case, the new content is displayed (S3030). 30 

This new content is the same as the content which 
was displayed initially, and so is achieved by displaying 
the image data 2150 with the VE_id=0 as the back- 
ground image and on-screen display graphics in accord- 
ance with the content of the navigation information with 35 
the NE_id=0. 

The time when this next content is displayed is 14: 
59:00 on September 9, 1 996, so that the display screen 
becomes as shown by 3230 in Fig. 1 5. 

After the content display process has been per- 40 
formed the reception control unit 1 050 judges that there 
is the time indication 1 5:00:00 on September 9, 1 996 for 
the handler with the handler number "2" in the 
Time_Event_Part 2161 of the navigation information 
shown in Fig. 11 , and so sets the time indication flag at 45 
U V (S3050). 

Since the time indication flag is "1 " (S3070), the re- 
ception control unit 1050 obtains the present time 
(S3080) and adjusts the present time using the time dif- 
ference set for the country in which the data display con- so 
trol apparatus 1000 is located (S3090). 

The reception control unit 1 050 next judges whether 
the present time has reached the time indicated by the 
Time_Event_Part2161 of the navigation information NE 
(S3100). 55 

If the present time reaches 1 5:00:00 on September 
9, 1996, the reception control unit 1050 activates han- 
dler 2. In more detail, the reception control unit 1050 
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refers to the Handler_Part 21 63 and the Bytecode_Part 
21 62 of the navigation information NE shown in Fig. 1 1 , 
and has the set of bytecodes "PushLO, PushU, Set- 
GraphicVisibility, PushLO, PushLO, SetGraphicVisibility, 
PushLI, PushLO, SetGraphicVisibility 0 executed by the 
bytecode interpreter 1051. 

The bytecode interpreter 1051 first interprets 
"PushL2 u and stores the value "2" in the stack, before 
interpreting "PushLI" and storing the value "1" in the 
stack. The bytecode interpreter 1051 next interprets 
"SetGraphicVisibility" and, since this is an instruction 
which sets the state of visibility or invisibility for graphics 
indicated by the second operand in accordance with the 
value of the first operand, extracts the first variable "1" 
from the stack indicating visibility and the second varia- 
ble "2 n from the stack indicating the graphics with the 
graphics number "2", before setting the graphics with 
the graphics number "2" as visible. 

Following this, the bytecode interpreter 1051 inter- 
prets the bytecode "PushLO, PushLO, SetGraphicVisi- 
bility" and makes the graphics with the graphics number 
"0" invisible, and then interprets the bytecode "PushLI, 
PushLO, SetGraphicVisibility" and makes the graphics 
with the graphics number "1 " invisible. 

As a result of the above processing, the bytecode 
interpreter 1051 of the reception control unit 1050 
makes the "This offer is no longer valid" button visible, 
while making the "Video" and "Stereo" buttons invisible 
so that the display screen changes to the display shown 
as 3240 in Fig. 15. 

By operating as described above, the data display 
control apparatus 1 000 is able to process the specified 
handler at the indicated time. 

Acquisition of the Present Time and Adjustment for Time 
Difference 

The following is a detailed description of the acqui- 
sition of the present time and the adjustment of time dif- 
ference by the data display control apparatus 1000. 

Figs. 16A and 16B show the data constructions of 
the TDT and the TOT The information given in brackets 
shows examples of the content of these tables. 

The TDT is the table which stores the present time 
which, as shown in Fig. 16A, is given in year, month, 
day, hour, minute, second format. In the present exam- 
ple, the time 1 996/9/9 1 5:00:00 is given in the TDT with 
this data being transmitted at the time corresponding to 
its content. Here, the actual data is stored using a BCD 
(Binary Coded Decimal) code. 

The TOT, meanwhile, stores the present time and 
a plurality of time difference entries for different country 
codes. Here, country codes are predetermined codes 
for identifying countries. A country code is also perma- 
nently stored within the data display control apparatus 
1 000. The time differences are expressed as plus or mi- 
nus a time given as hours, minutes, seconds. In the 
present example, the time difference for the U.K. is giv- 
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en as °0 n and the time difference for Japan is given as 
°+9 hours". As a result, the data display control appara- 
tus 1 000 is able to find the time difference for the country 
code which matches its own country code, and so can 
perform adjustment for the time difference. s 

The TDT and TOT are assigned predetermined 
PIDs and are successively transmitted from the data 
transmission apparatus as time progresses. 

Here, when the data display control apparatus 1000 
needs to know the present time, the reception control 10 
unit 1 050 sets the predetermined PID into the filter con- 
dition storage unit 1021 , and the received time informa- 
tion is stored in the time information storage unit 1044 
in the received data storage unit 1040 via the reception 
unit 1010 and the TS decoder unit 1020. This time in- is 
formation is then used by the reception control unit 
1050. 

The reception control un it 1 050 obtains the TDT and 
the TOT in S3080 as described above. In S3090, the 
reception control unit 1050 refers to the country code 20 
permanently stored in the data display control apparatus 
1000 and converts the time into the time for the country 
in which the data display control apparatus 1000 is lo- 
cated. 

In S3100, the reception control unit 1050 compares 25 
the present time with the time indicated in the 
Time_Event_Part of the present navigation information 
NE. In this first embodiment, the time given in the 
Time_Event_Part is set as the time for the country in 
which the data display control apparatus 1000 is locat- 30 
ed. It should be noted here that regardless of how the 
standard time is set, the handler can be activated at the 
proper time by performing compensation for time when 
comparing the standard time to the present time. 

Here, the time difference referred to by the compen- 35 
sation for time difference is a difference between a the 
respective standard times of the current time and the 
time given in the Time_Event_Part. 

With the data display control apparatus of this first 
embodiment of the present invention, handlers can be 40 
activated at their indicated time. Here, handlers are ex- 
ecuted according to bytecodes that are in turn made up 
of instructions for performing a variety of operations, so 
that a variety of operations, such as content switching, 
and changes in the display of buttons, and other oper- *s 
ations, are possible. 

Second Embodiment 

The following is an explanation of the second em- so 
bodiment of the present invention, which is a data dis- 
play control apparatus that includes a construction for 
changing the operations performed in response to user 
operations according to the time such user operations 
are made. 55 

It should be noted here that the only difference with 
the data transmission apparatus of the first embodiment 
lies in the content of the transmitted navigation informa- 



tion, so that other elements will not be described. In- 
stead, the following explanation will describe the 
present data display control apparatus in terms of the 
content of the navigation information. 

The data display control apparatus of this second 
embodiment has a feature whereby it sets a valid period 
for each handler and, when activating a handler in re- 
sponse to a user operation, activates an optimal handler 
for the time at which the user operation is made. This is 
an extension of the characteristic feature of the first em- 
bodiment of the present invention. 

Construction 

The construction of the data display control appa- 
ratus of the second embodiment is the same as that of 
the first embodiment (see Fig. 7), so that the data display 
control apparatus 1000 is composed of a reception unit 
101 0, a TS decoder unit 1 020, an AV decoder unit 1 030, 
a received data storage unit 1040, a reception control 
unit 1050, a reproduction unit 1060, a display unit 1070, 
an audio output unit 1080, and a signal reception unit 
1100. The operation of the reception control unit 1050, 
however, is different in the second embodiment, so that 
this will be described in more detail bellow. 

Data Construction [ 

Of the data handled by the data display control ap- 
paratus of the second embodiment, only the navigation 
information differs from the data described in the first 
embodiment, with the other kinds of data being the same 
as before. 

The data construction of the navigation information 
2170 is shown in Fig. 17. This navigation information 
2170 is an extension of the navigation information 2160 
described in the first embodiment, and includes a 
Time_Event_Part 2171, a Bytecode_Part 2172, a 
Handler_Part 2173, a Graph ics_Property_Part 2174, a 
Bitmap_lnformation_Part 2175, and a Hyperlink. 
lnformation_Part 2176. 

Here, the Time_Event_Part 2171 is the same as the 
Time.Event.Part -2161 in the first embodiment, the 
Bytecode_Part 2172 is the same as the Bytecode_Part 
2162, the Graphics.Property.Part 2174 is the same as 
the Graphics_Property_Part 2164, the Bitmap. 
Information.Part 2175 is the same as the Bitmap. 
Information.Part 2165, and the Hyperlink. 
Information.Part 2176 is the same as the Hyperlink. 
Information.Part 2166, with the only the set values be- 
ing different for explanatory purposes (see Fig. 11). 

The only difference with the first embodiment lies in 
the Handler_Part 21 73 that includes valid periods which 
have been set for each of the handler numbers. 

For the example shown in Fig. 17, the valid sub- 
handler for the handler number 0 until the time 1 4:59:59 
on September 9, 1996 is sub-handler number 0, while 
the valid sub-handler for the handler number 0 from the 
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time 15:00:00 on September 9, 1996 onwards is sub- 
handler number 2. In the same way, the valid sub-han- 
dler for the handler number 1 until the time 14:59:59 on 
September 9, 1996 is sub-handler number 1, while the 
valid sub-handler for the handler number 1 from the time 
1 5:00:00 on September 9, 1 996 onwards is sub-handler 
number 2. Here, sub-handler number 0 corresponds to 
bytecode number 0, while sub-handler number 1 corre- 
sponds to bytecode number 1 and sub-handler number 
2 corresponds to bytecode number 2. 

It should be noted that while this setting of a valid 
period has been given as a starting time and ending 
time, a setting of only one of these may alternatively be 
used, while no setting of starting time or ending time cor- 
responds to a case when a handler is always valid. 

Fig. 1 8 shows the data construction of navigation 
information 2270 and Fig. 19 shows the data construc- 
tion of navigation information 2370. These sets of nav- 
igation information 2270 and 2370 have the same data 
construction as navigation information 2170 described 
above. 

Operation of the Reception Control Unit 1050 

The following is an explanation of the operation of 
the reception control unit 1 050 in the data display control 
apparatus 1 000 described above, with reference to the 
drawings. This operation will be described using con- 
tents 2100, 2200, and 2300 of Figs. 8 and 9 described 
in the first embodiment. The difference, however, lies in 
the replacement of the navigation information 2160, 
2260, and 2360 with the navigation information 2170, 
2270, and 2370, and a difference in the transformation 
between the contents shown in Fig. 8. 

The reception control unit 1050 is composed of a 
CPU and a program, and performs the processing for 
content switching and handler activation. The funda- 
mental operation is the same as in the first embodiment 
(see Fig. 14), with the only difference being in the 
processing in the handler activation process of S31 30. 
This is described in more detail below. 

Fig. 20 is a flowchart for the operation during han- 
dler activation in the second embodiment. 

The handler activation process is composed of a 
process in S3131 and S3132 for obtaining the present 
time, and a process in S3133 to S3137 forjudging the 
validity of the sub-handlers, which are units of the han- 
dler to be activated, based on their valid periods, and 
for activating valid sub-handlers. 

The present explanation supposes that the present 
time is 14:58:00 on September 9, 1996 and that the user 
has selected and activated the "Video" button during a 
display of content 2100. 

The activation process for a handler starts with the 
acquisition of the present time (S3131). The reception 
control unit 1 050 obtains the TDT and TOT from the time 
information storage unit 1044 and obtains the standard 
time, before amending this time for the time difference 



of the country set for the data display control apparatus 
1000 (S3132). The acquisition of the present time and 
amendment for a time difference are performed in the 
same way as in the first embodiment, and result in the 
s time 1 4:58:00 on September 9, 1 996 being obtained. 
The reception control unit 1050 next focuses on one 
of the sub-handlers of the indicated handler (S3133) and 
judges whether the present time falls within the valid pe- 
riod of the focused sub-handler (S3134). The handler 
to indicated here is a handler that has been selected by a 
user selection operation for a button or, as in the first 
embodiment, a handler that has been activated due to 
its indicated time having been reached. 

In the example in Fig. 1 7, the button "Video" is se- 
15 lected so that the handler with the handler number "O" 
is activated. The reception control unit 1050 focuses on 
the sub-handler with the sub-handler number "0" for the 
handler n 0 n given in the Handler_Part 2173 (S3133), 
and, since this sub-handler is valid until 14:59:59 on 
September 9, 1 996 (S31 34), executes the bytecode cor- 
responding to the present sub-handler (S3135). As a re- 
sult, the bytecode with the bytecode number "0" corre- 
sponding to the sub-handler "O" is executed. Since the 
bytecode with the bytecode number "O" shown in the 
Bytecode_Part 2172 is "PushLO, GotoPage", the con- 
tent with "VE_id=1, NEjd=1 B ( given in the 
Hyperlink J nformation_Part 2176 is displayed 

After the processing for the sub-handler "0" has 
been completed, the reception control unit 1050 judges 
whether there is a next sub-handler (step 3136), and 
since there is another sub-handler with the sub-handler 
number "2", focuses on the sub-handler with the sub- 
handler number "2" (S3137). The reception control unit 
1050 then judges whether the present time is within the 
valid period of the sub-handler (S31 34), and since this 
is not the case, skips the execution of the sub-handler. 
The reception control unit 1050 then finds that there are 
no more sub-handlers, and so completes the handler 
activation process. 

The following is a description of the transformation 
of the display screen in the second embodiment, with 
reference to Fig. 21 . 

Display screen transformation 3310 shows the 
transformation in the screen that is displayed at 14:58: 
00 on September 9, 1996 in the present example. As 
shown in the drawing, the displayed content switches 
from content 2100 to content 2200 in response to a se- 
lection of the "Video" button by the user. 

Next, the user selects the "Menu" button in content 
2200. Since the handler with the handler number "0" in 
the Handler_Part of the navigation information 2270 cor- 
responding to content 2200 is set to correspond to sub- 
handler 0 without a limited valid period, and the sub- 
handler 0 corresponds to bytecode 0, the reception con- 
trol unit 1050 has the bytecode interpreter 1051 execute 
the bytecode 0, so that content 2100 is displayed. 

After this, time passes and the present time reaches 
15:01:00 on September 9, 1996. 
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Here, if the user selects the "Video" button, the han- 
dier activation process will be as described below. 

First, the reception control unit 1050 obtains the 
present time (S3131) and amends the time using the 
time difference (S3132). By doing so, the time, 15:01: 
00 on September 9, 1996 is obtained. 

Next, the reception control unit 1050 focuses on the 
first sub-handler for the indicated handler (S3133), and 
judges whether the present time is within the valid period 
(S31 34). For the example shown in Fig. 1 7, the selection 
of the "Video" button results in the activation of the han- 
dler with the handler number "0", so that the reception 
control unit 1050 first focuses on the sub-handler "0° 
(S31 33). Since this sub-handler is only valid until 1 4:59: 
00 on September 9, 1 996, this sub-handler is judged as 
invalid (S31 34) and so is not executed. The reception 
control unit 1050 then focuses on the sub-handler with 
the sub-handler number "2" (S3136, S3137) which is 
valid from 1 5:00:00 on September 9, 1 996 onwards. Ac- 
cordingly, the reception control unit 1050 judges that this 
sub-handler "2" is valid (S3134) and so executes the 
bytecode corresponding to the sub-handler "2" (S31 35). 

The bytecode with the bytecode number "2" given 
in the Bytecode_Part 2172 is "PushL2, PushLI, Set- 
Graphic Visibility, PushLO, PushLO, SetGraphicVisibility, 
PushLI, PushLO, SetGraphicVisibility", so that in the 
same way as in the first embodiment, the button "This 
offer is no longer valid" is made visible, and the "Video" 
and "Stereo" buttons are made invisible. 

After executing this bytecode, there are no more 
sub-handlers (S3136), so that the reception control unit 
1050 terminates the handler activation process: 

As a result, the display screen is transformed as 
shown in 3320 in Fig. 21, so that the display switches 
from content 21 00 to content 2400 in response to a user 
selection of the "Video" button. 

As described above, the data display control appa- 
ratus 1 000 of the second embodiment of the present in- 
vention is able to handle navigation information which 
has a data construction that includes valid periods for 
handlers, meaning that a greater variety of processes 
are available in response to time. 

Third Embodiment 

The following is an explanation of the data display 
control apparatus of the third embodiment of the present 
invention. This data display control apparatus receives 
a digital broadcast and is characterized by including a 
construction for performing certain operations only 
when specified graphics are displayed at a specific time. 

The data transmission apparatus of this third em- 
bodiment differs from the first embodiment in only the 
content of the transmitted navigation information, so that 
the construction of the data display control apparatus 
has been omitted. Instead, the data display control ap- 
paratus of this third embodiment will be described in 
terms of the content of the navigation information. 



The data display control apparatus of this third em- 
bodiment has a function for only performing certain op- 
erations when specified graphics are displayed, in ad- 
dition to the function of the first embodiment whereby 
s an specified operation is performed at an indicated time. 

Construction 

The construction of the data display control appa- 
10 ratus of the third embodiment is the same as that of the 
first embodiment (see Fig. 7), so that the data display 
control apparatus 1 000 is composed of a reception unit 
1 01 0, a TS decoder unit 1 020, an AV decoder unit 1 030, 
a received data storage unit 1040, a reception control 
is unit 1 050, a reproduction unit 1 060, a display unit 1 070, 
an audio output unit 1 080, and a signal reception unit 
1100. The operation of the reception control unit 1050, 
however, is different in the third embodiment, so that this 
will be described in more detail below. 

20 

Data Construction 

Of the data handled by the data display control ap- 
paratus of the third embodiment, only the navigation in- 

25 formation differs from the data described in the first em- 
bodiment, with the other kinds of data, being the same 
as before. \ 

The data construction of the navigation information 
2180 is shown in Fig. 22. This navigation information 

30 21 80 is an extension of the navigation information 21 60 
described in the first embodiment, and includes a 
Time_Event_Part 2181, a Bytecode_Part 2182, a 
Handler_Part 2183, a Graph ics_Property_Part 2184, a 
BitmapJnformation_Part 2185, and a Hyperlink. 

35 lnformation_Part 2186. 

Here, the Bytecode_Part 2182 is the same as the 
Bytecode_Part 2162 in the first embodiment, the 
Handler_Part 2183 is the same as the Handler_Part 
2163, the Graphics_Property_Part 2184 is the same as 

40 the Graphics_Property_Part 2164, the Bitmap. 
lnformation_Part 2185 is the same as the Bitmap_ 
lnformation_Part 2165, and the Hyperlinkjnfor- 
mation_Part 2186- is the same as the Hyperlinkjnfor- 
mation_Part 2166 (see Fig. 11). 

45 The only difference with the first embodiment lies in 
the Time_Event_Part 2181 which, in addition to the ac- 
tivate times and handler numbers of - the 
Time_Event_Part 2161 of the first embodiment, con- 
tains graphic numbers. 

50 For the example shown in Fig. 22, the Time Event 
Part 2181 shows that if the present time reaches 15:00: 
00 on September 9, 1996 and the graphics with the 
graphics numbers "0 W and "1° are being visibly dis- 
played, the processing with the handler number "2" will 

55 be performed. 
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Operation Control Construction 

The following is an explanation of the operation of 
the reception control unit 1050. Here, the flowchart in 
Fig. 23 shows the content switching process and acti- 
vation of a handler. With the exception of the provision 
of step S5101 corresponding to the Time_Event_Part 
2181 in the navigation information, this flowchart is the 
same as Fig, 1 4 which showed the operation of the re- 
ception control unit 1050 in the first embodiment. Ac- 
cordingly, only S5101 will be described. 

Step S5101 is a process performed as a branch 
from step S5100 when the activate time of 15:00:00 on 
September 9, 1996 in the Time_Event_Part 2181 has 
been reached. Here, the reception control unit 1050 
judges whether the graphics with the graphics numbers 
"0" and "1 0 given in the Time_Event_Part 21 81 are being 
displayed and, if so, executes the handler activation 
process (S5130). When these graphics are not being 
displayed, the reception control unit 1 050 performs the 
processing for the movement of the selection pointer in 
accordance with user inputs (S5110). 

As a result, when graphics "0" and "1 " are being dis- 
played and the present time reaches 15:00:00 on Sep- 
tember 9, 1 996, the reception control unit 1 050 activates 
the handler with the handler number "2". 

Here, by providing navigation information and an re- 
ception control unit which controls the display of data by 
referring to the navigation information, it becomes pos- 
sible to achieve control of time-based operations in ac- 
cordance with the graphics that are being displayed. De- 
velopers of programs are thereby able to produce pro- 
grams where the state of the displayed graphics chang- 
es according to user operations, allowing the display to 
be controlled more precisely. 

Fourth Embodiment 

The following is an explanation of the data display 
control apparatus of the fourth embodiment of the 
present invention. This data display control apparatus 
receives a digital broadcast and is characterized by in- 
cluding a construction for performing control to display 
or not display graphics at a specific time. 

The data transmission apparatus of this fourth em- 
bodiment differs from the first embodiment in only the 
content of the transmitted navigation information, so that 
the construction of the data display control apparatus 
has been omitted. Instead, the data display control ap- 
paratus of this fourth embodiment will be described in 
terms of the content of the navigation information. 

Construction 

The construction of the data display control appa- 
ratus of the fourth embodiment is the same as that of 
the first embodiment (see Fig. 7), so that the data display 
control apparatus 1 000 is composed of a reception unit 



1010, a TS decoder unit 1 020, an AV decoder unit 1030, 
a received data storage unit 1040, a reception control 
unit 1050, a reproduction unit 1060, a display unit 1070, 
an audio output unit 1080, and a signal reception unit 
5 1100. The operation of the reception control unit 1050, 
however, is different in this fourth embodiment, so that 
this will be described in more detail below. 

Data Construction 

10 

Of the data handled by the data display control ap- 
paratus of the fourth embodiment, only the navigation 
information differs from the data described in the first 
embodiment, with the other kinds of data being the same 

*5 as before. 

The data construction of the navigation information 
6160 is shown in Fig. 24. This navigation information 
6160 corresponds to the navigation information 2160 
described in the first embodiment, and includes a 

20 Bytecode_Part6162, aHandler_Part6163, aGraphics__ 
Property_Part 6164, a Bitmap_lnformation_Part 6165, 
and a Hyperlink_lnformation_Part 6166. 

Here, the Bytecode_Part 6162 is the same as the 
Bytecode_Part 2162 in the first embodiment, the 

25 Handler_Part 6163 is the same as the Handler_Part 
21 63, the Bitmap_lnformation_Part 61 65 is the same as 
the Bitmap J nformation_Part 2165, and the 
Hyperlink_lnformation_Part 6166 is the same as the 
Hyperlink_lnformation_Part2166 (see Fig. 11). 

30 The differences with the first embodiment lie in the 
lack of a Time_Event_Part in the present embodiment, 
and in the construction of the Graph ics_Property_Part. 

In addition to the graphics numbers, graphics types, 
coordinates, handler numbers, and initial states of the 

35 Graph ics_Property_Part 2164 of the first embodiment, 
the Graphics_Property_Part 6164 additionally includes 
information for a pairing of a time and display state. Note 
here that it is also possible for a plurality of pairings of 
a time and display state to be given in this Graphics_ 

40 Property_Part. 

For the example shown in Fig. 24, the 
Graphics_Property_Part 6 1 64 includes a time and a dis- 
play state for each of graphics numbers 0, 1 , and 2, so 
that the button with the graphics number 0 and the but- 

45 ton with the graphics number 1 are made invisible at 1 5: 
00:00 on September 9, 1996, while the button with the 
graphics number 2 is made visible at 15:00:00 on Sep- 
tember 9, 1996. 

50 Operation Control Construction 

The following is an explanation of the operation of 
the reception control unit 1050 based on the example 
data shown in Fig. 24. Here, operations which are the 
55 same as those described in the first. embodiment have 
been omitted. 

Fig. 25 is a flowchart showing the content switching 
process and the process for activation of a handler in 
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the present fourth embodiment. Fig. 26 shows the trans- 
formation in the display screen in this fourth embodi- 
ment. 

The reception control unit 1 050 first displays the first 
content given as the information designated by the s 
VE_id and the NEjd given in the PMT in the system 
information storage unit 1043 (S6510). The following ex- 
planation will deal with the case when "VE_id=0 M and 
"NE_id=0" is given in the PMT The explanation also 
supposes that the present time is 1 4:59:00 on Septem- 10 
ber 9, 1996. 

The reception control unit 1050 obtains the present 
time and adjusts it using the time difference (S6520, 
S6530). Here, since the Graph ics_Property_Part 6164 
states that the graphics for 0 Video" with the graphics 1$ 
number n 0" have an initial state of "visible" but should 
be invisible after 15:00:00 on September 9, 1996, the 
reception control unit 1050 judges that these graphics 
should be visible at the present time of 1 4:59:00 on Sep- 
tember 9, 1996 (S6540, S6550), and so makes these 20 
graphics visible (S6560). Next, the reception control unit 
1 050 focuses on the graphics "Stereo" with the graphics 
number "1 " (S6580, S6540), judges that these graphics 
should also be made visible (S6550), and so makes 
these graphics visible (S6560). Next, the reception con- 25 
trol unit 1050 focuses on the graphics "This offer is no 
longer valid" with the graphics number "2" (S6580, 
S6540), but since these graphics should only be made 
visible after 1 5:00:00 on September 9, 1 996, judges that 
these graphics should be invisible at the present time of 30 
14:59:00 on September 9, 1996 (S6550), and so makes 
these graphics invisible (S6570). This display state is 
shown as 6810 in Fig. 26. 

On completing the graphics display processing, the 
reception control unit 1 050 moves the selection pointer 35 
in accordance with the user inputs (S6590), and, when 
there has been a button selection and activation opera- 
tion by the user (S6600), activates the handler corre- 
sponding to the selected button (S6610). 

Hereafter, time passes and the present time be- *o 
comes 15:00:00 on September 9, 1996. 

The reception control unit 1050 obtains the present 
time and adjusts it using the time difference (S6520, 
S6530). Here, since the Graphics_Property_Part 6164 
states that the graphics for "Video" with the graphics 
number "0" have an initial state of "visible" but should 
be invisible after 15:00:00 on September 9, 1996, the 
reception control unit 1050 judges that these graphics 
should be made invisible at the present time of 15:00: 
00 on September 9, 1996 (S6540, S6550), and so so 
makes these graphics invisible (S6570). Next, the re- 
ception control unit 1050 focuses on the graphics "Ster- 
eo" with the graphics number "1 " (S6580, S6540), judg- 
es that these graphics should also be made invisible 
(S6550), and so makes these graphics invisible 55 
(S6570). After this, the reception control unit 1050 fo- 
cuses on the graphics "This offer is no longer valid" with 
the graphics number "2" (S6580, S6540). Since the 



Graphics_Property_Part 6164 states that these graph- 
ics have an initial state of "invisible" but should be visible 
after 1 5:00:00 on September 9, 1 996, the reception con- 
trol unit 1 050 judges that these graphics should be made 
visible at the present time of 15:00:00 on September 9, 
1996 (S6550), and so makes these graphics visible 
(S6560). 

As a result of the operation described above, the 
display screen becomes as shown as 6820 in Fig. 26. 

With the data display control apparatus of the 
present embodiment, control can be performed to dis- 
play or not display graphics at a time which is indicated 
separately for each set of graphics. 

Fifth Embodiment 

The following is an explanation of the data display 
control apparatus of the fifth embodiment of the present 
invention. This data display control apparatus receives 
a digital broadcast and is characterized by including a 
construction for adjusting the starting times of programs 
and starting programs once a specified time has been 
reached. 

The data transmission apparatus of this fifth em- 
bodiment differs from the first embodiment in only the 
content of the transmitted navigation information, so that 
the construction of the data display control apparatus 
has been omitted. Instead, the data display control ap- 
paratus of this fifth embodiment will be described in 
terms of the content of the navigation information. 

Construction 

The construction of the data display control appa- 
ratus of the fifth embodiment is the same as that of the 
first embodiment (see Fig. 7), so that the data display 
control apparatus 1000 is composed of a reception unit 
1 01 0, a TS decoder unit 1 020, an AV decoder unit 1 030, 
a received data storage unit 1040, a reception control 
unit 1050, a reproduction unit 1060, a display unit 1070, 
an audio output unit 1080, and a signal reception unit 
1100. The operation of the reception control unit 1050, 
however, is different in this fifth embodiment, so that this 
will be described in more detail below. 

Data Construction 

Of the data handled by the data display control ap- 
paratus of the fifth embodiment, only the navigation in- 
formation differs from the data described in the first em- 
bodiment, with the other kinds of data being the same 
as before. 

The data construction of the navigation information 
7160 is shown in Fig. 27. This navigation information 
7160 corresponds to the navigation information 2160 
described in the first embodiment, and includes a 
Time_Event_Part 7161, a Bytecode_Part 7162, a 
Handler_Part 7163, a Graphics_Property_Part 7164, a 
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Bitmap J nformation_Part 7165, and a Hyperlink_ 
information_Part7166. 

Here, the Time„Event_Part 7161 is the same as the 
Time_Event_Part 2161 in the first embodiment, the 
Bytecode_Part 71 62 is the same as the Bytecode_Part 5 
2162, the Handler_Part 7163 is the same as the 
HandIer_Part 2163, the Graph ics_Property_Part 7164 
is the same as the Graphics_Property_Part 2164, the 
Bitmap J nformation_Part 7165 is the same as the 
Bitmap_lnformation_Part 2165, and the Hyperlink_ 10 
lnformatioo_Part 7166 is the same as the Hyperlink^ 
lnformation_Part2166 (see Fig. 11). 

The difference with the data construction of the first 
embodiment lies in the incfusion of an NE start time in 
addition to the NE_id in each navigation element. is 

For the example in Fig. 27, the NE start time shows 
that execution can only be performed from 14:00:00 on 
September 9, 1996 onwards, so that even if there is a 
user operation which selects the content corresponding 
to the navigation element with the NE_id "0 U before 14: 20 
00:00 on September 9, 1996, the data display control 
apparatus will wait until the present time reaches 1 4:00: 
00 on September 9, 1996 before referring to the navi- 
gation element with this NE_id "O" and performing the 
control of the display. 25 

Operation Control Construction 

The following is an explanation of the operation of 
the reception control unit 1050 based on the example 30 
data shown in Fig. 27. Here, operations which are the 
same as those described in the first embodiment have 
been omitted. 

Fig. 28 is a flowchart showing the content switching 
process and the process for activation of a handler in 35 
the present fifth embodiment. 

This explanation supposes that the present time is 
1 3:59:00 on September 9, 1 996, and that the user has 
made a selection and activation operation for a button 
which switches from a given content to a content iden- 40 
tified by NE_id=0 and VE_id=0. 

The reception control unit 1050 judges that there 
has been a content switching (S7510), obtains the 
present time, and adjusts the present time using the time 
difference (S7520, S7530). 45 

After this, the reception control unit 1050 refers to 
the navigation element with the NE_id=0, finds that the 
NE start time is given as 14:00:00 on September 9, 
1996, obtains the present time once again, and per- 
forms adjustment for the time difference (S7540, S7520, 50 
and S7530). 

Here, time passes and the processing in steps 
S7540, 7520, and S7530 are repeated until the present 
time is judged to have reached 14:00:00 on September 
9, 1 996 (S7540), at which point the content is displayed 55 
(S7550). 

The following processes (S7560-S7650) are the 
same as S3040-S3130 in the first embodiment, and so 



will not be described. 

By operating in this way, the reception control unit 
1050 can display contents only after an indicated time 
has been reached, so that a digital broadcasting system 
can perform control in accordance with the progression 
of programs while maintaining their interactive aspects. 

Sixth Embodiment 

The following is an explanation of the data display 
control apparatus of the sixth embodiment of the present 
invention. This data display control apparatus receives 
a digital broadcast and is characterized by including a 
construction for performing control to execute a speci- 
fied operation once a predetermined time period has 
elapsed from the start of display of a content. 

The data transmission apparatus of this sixth em- 
bodiment differs from the first embodiment in only the 
content of the transmitted navigation information, so that 
the construction of the data display control apparatus 
has been omitted. Instead, the data display control ap- 
paratus of this sixth embodiment will be described in 
terms of the content of the navigation information. 

Construction ( 

The construction of the data display control appa- 
ratus of the sixth embodiment is the same as that of the 
first embodiment (see Fig. 7), so that the data display 
control apparatus 1000 is composed of a reception unit 
1010, a TS decoder unit 1 020, an AV decoder unit 1030, 
a received data storage unit 1040, a reception control 
unit 1050, a reproduction unit 1060, a display unit 1070, 
an audio output unit 1080, and a signal reception unit 
1100. 

The time information storage unit 1044 in the re- 
ceived data storage unit 1040 differs to the first embod- 
iment in that the present time is stored by a counting unit 
(not illustrated) provided in the data display control ap- 
paratus. The present time calculated by this counting 
unit is expressed as hours, minutes, seconds, and 
frames, such as 11 hours, twenty minutes, 30 seconds 
and 15 frames, where one frame is one thirtieth of one 
second. Here, however, one frame may be set as one 
twenty-fifth of one second, so that the term ,l frame" sim- 
ply represents a predetermined unit of time. 

The operation of the reception control unit 1 050 dif- 
fers to that in the first embodiment, with this being de- 
scribed in more detail below. 

Display Screens and Data Composing Contents 

The following is an explanation of the display of con- 
tents by the data display control apparatus 1000 and of 
the data composing contents, with reference to Figs. 29, 
30, and 31. 

Fig. 29 shows example display screens for the data 
display control apparatus 1 000 of the sixth embodiment 
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of the present invention. These display screens relate 
to a quiz program, and include a content 81 00 displaying 
a question, a content 8200 displaying indicating that a 
correct answer has been given, a content 8300 display- 
ing indicating that an incorrect answer has been given, 5 . 
and a content 8400 displaying that time is up. 

In this example, when the content 8100 for the 
question "Which is a red fruit ?" is displayed on the dis- 
play screen and the user selects and confirms the "Ap- 
ple" button 8110, the display screen switches, as shown 10 
by the arrow 8010, to a display of the content 8200 
showing that the correct answer has been given. In the 
same way, when the user selects and confirms the "Tan- 
gerine" button 8120, the display screen switches, as 
shown by the arrow 8020, to a display of the content 1$ 
8300 showing that an incorrect answer has been given. 

When ten seconds have passed from the start of 
the display of content 81 00, the display switches to con- 
tent 8400 showing that time is up. 

20 

Data Transmission Apparatus 

To allow the data display control apparatus of the 
sixth embodiment of the present invention to perform the 
switching of display in response to interactive opera- 25 
tions, data composing the contents is transmitted as de- 
scribed below. 

It should be noted that the data transmission appa- 
ratus of the sixth embodiment has the same construc- 
tion as the data transmission apparatus 101 described 30 
in the related art section. As described below, however, 
unlike the navigation information of the related art, the 
navigation information of the present embodiment in- 
cludes information to allow control with a time element. 

Fig. 30 gives a simplified representation of the data 35 
transmitted by the data transmission apparatus. Fig. 30 
shows the data that composes the contents shown in 
Fig. 29, with the data 8000 being transmitted with a pre- 
determined period by the data transmission apparatus. 
This transmitted data 8000 is composed of the sets of 40 
image data 8150, 8250, 8350, and 8450, and the sets 
of navigation information 8160, 8260, 8360, and 8460. 

These sets of image data 8150, 8250, 8350, and 
8450 are the background images for the contents 8100, 
8200, 8300, and 8400 which are displayed on the dis- 
play screen of the data display control apparatus 1 000. 

The data transmission apparatus repeatedly multi- 
plexes and transmits the data 8000 with a predeter- 
mined interval, with this transmission being the same as 
shown in Fig. 4 of the related art section, except that the so 
image data and navigation information in Fig. 4 are re- 
placed with those shown in Fig. 30. The multiplexing is 
also performed in the same manner as shown in Fig. 5 
of the related art section. 

55 

Detailed Description of the Navigation Information 
The following is a description of the navigation in- 



formation shown in outline in Fig. 30, with reference to 
Fig. 31. 

Fig. 31 shows the data construction of the naviga- 
tion information 8160. This navigation information is 
composed of a Time_Event_Part 8161, a Bytecode_ 
Part 8162, a Handler_Part 8163, a Graphics_Property_ 
Part 8164, a Bitmap Jnformation_Part 8165, and a 
Hyperlink_!nformation_Part 8166. 

The data construction of the navigation information 
8160 is largely the same as the data construction of the 
navigation information 2160 in the first embodiment, al- 
though there are differences in the Time_Event_Part 
8161. 

The Time_Event_Part 8161 corresponds to the in- 
formation shown as "Time_Event" in Fig. 30, and is used 
to record information for activating a specified handler 
when an indicated time has elapsed from the start of 
display of the content. In the example of Fig. 31 , the han- 
dler with the handler number "2" is activated ten sec- 
onds from the start of display of the content. Here, it is 
possible for a plurality of elapsed times before activation 
to be recorded in the Time_Event_Part. These elapsed 
times are given in hour, minute, second, and frame for- 
mat. 

The Bytecode_Part 8162 is used to' record the byte- 
codes. In the example of Fig. 31, the bytecode with the 
bytecode number "0" is "PushLO, GotoF*age" expressing 
a switch of display to a content shown by link number 
"0", the bytecode with the bytecode number "1" is 
"PushLI , GotoPage" expressing a switch of display to 
a content shown by link number "1", and the bytecode 
with the bytecode number "2" is n Pusht_2, GotoPage" 
expressing a switch of display to a content shown by link 
number "2". 

The BitmapJnformation_Part 8165 records the 
contents of the bitmaps used to display the buttons cor- 
responding to different graphics numbers. In the exam- 
ple in Fig. 31 , the graphics number "0" corresponds to 
the bitmap for "Apple" and the graphics number "1 " cor- 
responds to the bitmap for "Tangerine". 

The Graphics_Property_Part 8164 is information 
for composing the on-screen display graphics. In the ex- 
ample in Fig. 31,- the graphics type is "Button", the 
graphics numbers "0" and "1" correspond to the num- 
bers of the graphics included in the Bitmap. 
lnformation_Part, and the coordinates of button "0" and 
button "1" are given as (20,20) and (20,60). The han- 
dlers which are activated when button "0" and button "1" 
are selected are given as handler numbers "0" and "1 ", 
and the initial states of the buttons for the display of the 
contents are both given as "visible". 

The Hyperlink_lnformation_Part 8166 records the 
IDs of the materials that compose the link destination 
contents, and has a collection of identifiers correspond- 
ing to each content that is identified as a link number. 
For the example in Fig. 31, °VEjd=1" is given as the 
link destination for link "0", and so shows that the content 
composed of the image data with the VE_id "1 " is a link 
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destination. The link destination tor the link number "1 " 
is shown as the content composed of the image data 
with the VE_id=2, and the link destination for the link 
number "2" is shown as the content composed of the 
image data with the VE __id=3. 

It should be noted here that NE_id given as "0" at 
the top of Fig. 31 shows that the navigation information 
being explained here is the navigation element which 
has the ID "0". 

The navigation information with this "NE_id=0" 
forms a content together with the image data for display- 
ing the question that has the VE jd "0 ! \ 

Using the data described above, a new content will 
be displayed when a user makes a button operation in 
response to a content displayed by the data display con- 
trol apparatus 1000. Also, when the time period given 
in the Time_Event_Part has elapsed from the start of 
display of a content, control is performed to execute the 
specified operation. 

Operation of the Data Display Control Apparatus 

The following is a description of the operation of the 
reception control unit 1050 of the data display control 
apparatus 1000 based on the data construction de- 
scribed above, with reference to the drawings. 

Fig. 32 is a flowchart showing the content switching 
process and activation of a handler, while Figs. 33A and 
33B show the transformation in the display screen when 
the user gives an answer within the set response time, 
and when the user does not give an answer within the 
set response time. 

The processing of the reception control unit 1050 is 
composed of steps S8510 to S8620 in Fig. 32. Step 
S8510 is an initial process for indicating the content to 
be displayed first when the reception of a program is 
commenced. When S8520 judges that content switch- 
ing has been performed, steps S8530 to S8560 are per- 
formed. When S8570 judges that there is a handler to 
be executed at an indicated time, the processes in 
S8580 and S8590 are performed. Steps S8600 and 
S8610 are performed in response to user inputs and 
step S8620 is performed to activate a handler. 

The information specifying the first content is given 
as a pair of a VE_id and an NEjd in the PMT stored in 
the system information storage unit 1043. In the follow- 
ing explanation, an example where the information 
"VE_id=0" and °NEjd-0 u is given in the PMT is used. 

First, the reception control unit 1050 obtains the in- 
formation "VE_id=0 n , "NE_id=0" from the PMT as the 
information for the content to be displayed first (S851 0). 

Since this is the first content, the system considers 
that content switching has been performed (S8520:Yes) 
and so displays the present content (S8530). 

The display of this first content is achieved by dis- 
playing the image data 8150 with the VE_id=0 as the 
background image and on-screen display graphics in 
accordance with the content of the navigation informa- 



tion with the NE _id=0. Here, the button "Apple" is visibly 
displayed at a position given by the coordinates (20,20) 
and the button "Tangerine" is visibly displayed at a po- 
sition given by the coordinates (20,60), in accordance 
s with the content of the Graphics_Property_Part 8164 
and the Bitmap_lnformation_Part 81 65 of the navigation 
information shown in Fig. 31 . This results in the display 
shown as 8910 in Fig. 33A. 

Once the present content has been displayed, the 
^0 reception control unit 1050 judges whether there is a 
time period indication for the activation of a handler at 
a specified period after the start of display in the 
Time_Event_Part of the NE (S8540), in which case the 
time period indication flag for handler activation 
f$ processing in response to time is set at "1" (S8550). 
When there is no time period indication, the time period 
indication flag is set at "0" (S8560). Here, since the han- 
dler with the handler number "2" in the Time_Event_Part 
of the navigation information shown in Fig. 31 is set as 
20 being activated at a point where ten seconds have 
elapsed from the start of display, the time period indica- 
tion flag is set at "1 " (S8550). 

When the time period indication flag has been set 
at "1" (S8570:Yes), the reception control unit 1050 
measures the elapsed time from the sjtart of display of 
the content (S8580) and judges whether the elapsed 
time has reached the time period indicated for the acti- 
vation of the handler in the Time_Event_Part 8161 of 
the NE (S8590). When the indicated period has not 
elapsed, the reception control unit 1050 switches to the 
processing for the movement of the selection pointer in 
accordance with user operations (S8600). When one of 
the buttons has been selected and activated (S8610), 
the reception control unit 1050 advances to the handler 
activation step (S8620). 

The case where the user gives his/her response five 
seconds from the start of display of the question is de- 
scribed below. 

Since ten seconds have not elapsed (S8580, 
S8590), the reception control unit 1050 proceeds to the 
processing for the movement of the selection pointer in 
accordance with user operations (S8600). When the us- 
er selects and activates the button "Apple" five seconds 
from the start of the display of the content (S8610), the 
reception control unit 1050 refers to the 
Graphics_Property_Part8164 and activates the handler 
with the handler number "0" (S8620). The handler with 
the handler number "0" is composed of the bytecode "0" 
whose content is "PushLO, GotoPage", so that content 
switching is performed to the content with the VE=id "1° 
for the link number "0" given in the Hyperlink. 
lnformation_Part 8166. This execution of bytecodes is 
performed by the bytecode interpreter 1051 of the re- 
ception control unit 1050. 

After activation of a handler (S8620), the reception 
control unit 1050 returns to S8520 to judge that content 
switching has been performed and so display the new 
content (S8530). This results in the display screen for a 



30 



35 



40 



45 



50 



28 



55 



EP0 830 019 A2 



56 



correct answer being displayed, as shown by display 
8920 in Fig. 33A. 

The case where the user does not gives his/her re- 
sponse within ten seconds from the start of display of 
the question is described below. Note that the display at 
the start of this procedure is display 8930 of Fig. 33B. 

Once ten seconds have elapsed from the start of 
display (S8580, S8590), the handler with the handler 
number "2" is activated (S8620). The handler with the 
handler number "2" is composed of the bytecode "2" 
whose content is "PushL2, GotoPage", so that content 
switching is performed to the content with the VEdd "3" 
for the link number "2° given in the Hyperlink. 
lnformation_Part 8166. 

After activation of a handler (S8620), the reception 
control unit 1050 returns to S8520 to judge that content 
switching has been performed (S8520) and so display 
the new content (S8530). This results in the display 
screen for "time up" being displayed, as shown by dis- 
play 8940 in Fig. 33B. 

By operating in this way, the data display control ap- 
paratus 1000 can execute the processing of a specified 
handler after a predetermined time period has elapsed 
starting from the display of a content by the data display 
control apparatus 1000. 

Seventh Embodiment 

The following is an explanation of the seventh em- 
bodiment of the present invention, with reference to the 
drawings. The present embodiment relates to a data dis- 
play control information editing apparatus which dis- 
plays the interrelations of contents at a time indicated 
by the user. 

Construction 

The construction of the data display control infor- 
mation editing apparatus of the seventh embodiment is 
shown by the block diagram in Fig. 34. 

The data display control information editing appa- 
ratus 10000 is composed of a time input receiving unit 
10010, a data storage unit 10020, a content relation 
judging unit 10030, and a content relation display unit 
10040. 

The time input receiving unit 10010 receives a user 
input of a standard time for displaying the interrelations 
of contents. Here, a direct numerical input of time made 
by the user is stored in an internal register (not illustrat- 
ed). 

The data storage unit 10020 stores the navigation 
information. The data construction of this navigation in- 
formation is the same as that described in the second 
embodiment (see Fig. 17). 

The content relation judging unit 10030 refers to the 
Handter_Part, the Bytecode_Part, and the 
HyperlinkJnformation_Part of the navigation informa- 
tion stored in the data storage unit 10020, and, by in- 



vestigating the contents of the bytecodes corresponding 
to the valid sub-handlers at the indicated time obtained 
by the time input receiving unit 10010, outputs the NE_id 
and VE_id of the contents that are link destinations for 

s the sub-handlers that are valid at the indicated time to 
registers (not illustrated) provided in the data display 
control information editing apparatus. 

The content relation display unit 1 0040 displays im- 
ages representing the contents and lines representing 

10 the links between contents on a display screen. 

Operation 

The following is a description of a specific example 

15 of the operation of the data display control information 
editing apparatus 10000 based on the example sets of 
navigation information shown in Figs, 17 to 19. A flow- 
chart for the operation of the data display control infor- 
mation editing apparatus 1 0000 is shown in Fig. 35. 

20 The content relation display unit 10040 first refers 
to the Handler_Part, the Bytecode_Part, and the 
HyperlinkJnformation_Part of the navigation informa- 
tion stored in the data storage unit 10020 and investi- 
gates the contents of the bytecodes corresponding to 

25 all of the sub-handlers. As a result, "^otoPage" is de- 
tected, and the NE_id and VE_id of all of the link desti- 
nation contents, are obtained (S10110, S1O120, 
S10130). The content relation display unit 10040 then 
displays the link relations of contents by displaying im- 

30 ages for the contents and lines representing the links 
between the contents (SI 01 40, S10150). Here, howev- 
er, the lines between contents are drawn as broken lines 
showing that the links are invalid. Icons are used in the 
display as the images for representing contents and 

35 each record the VE_id and N E_id of the elements which 
compose the content represented by the icon. 

Fig. 36 shows an example of a display screen dis- 
played by the data display control information editing ap- 
paratus 10000. 

40 After step S1 01 50 has been completed, the display 
screen is as shown by display 10300 in Fig. 36. 

The time input receiving unit 10010 next receives 
an user input of an indicated time (S1 0160), which in the 
present. example is 14:59:00 on September 9, 1996. 

45 The content relation judging unit 10030 first refers 
to the Handler_Part 2173 of the navigation information 
21 70 with the NE_id=0, and judges that the sub-handler 
"0" is valid at 1 4:59:00 on September 9, 1 996 (S1 01 70, 
S10180). The content relation judging unit 10030 then 

so detects the bytecode "PushLO, GotoPage" correspond- 
ing to the sub-handler "0" that executes a link to the con- 
tent with the link number "0", and so sets the link to the 
content given by the IME_id=1, VE_id=1 for the link 
number "0" as valid, storing the values NE_id=1, 

55 VE_id=1 in an internal register (S10190). 

Following this, the content relation judging unit 
10030 focuses on the sub-handlers "1" and "2" of the 
navigation information 2170, before focusing on the 
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sub-handler "0" of the navigation information 2270 and 
the sub-handler "0° of the navigation information 2370, 
and executing the same processing as described above 
(S10170, S10180, S10190, and S10200). 

As a result, the content relation display unit 10040 
draws solid lines showing the valid links between con- 
tents based on the information for links which are valid 
at the indicated time 14:59:00 on September 9, 1996 
(S10210). This results in the display shown as display 
10400 in Fig. 36. 

As described above, the data display control infor- 
mation editing apparatus of the seventh embodiment is 
able to display the links between contents at a time in- 
dicated by the user in a way which allows the user to 
distinguish valid links from invalid links. 

Eighth Embodiment 

The following is a description of the eighth embod- 
iment of the present invention, with reference to the 
drawings. 

In addition to the functions of the seventh embodi- 
ment, the data display control information editing appa- 
ratus of the eighth embodiment is able to update the in- 
formation for controlling the display of data. 

Construction 

Fig. 37 is a block diagram showing the construction 
of the data display control information editing apparatus 
of the eighth embodiment of the present invention. 

The data display control information editing appa- 
ratus 10500 is composed of a time input receiving unit 
10010, a data storage unit 10020, a content relation 
judging unit 1 0030, a content relation display unit 1 0040, 
a non-link destination content selection receiving unit 
10510 and a data updating unit 10520. 

The time input receiving unit 10010, the data stor- 
age unit 10020, the content relation judging unit 10030, 
and the content relation display unit 1 0040 are the same 
as in the seventh embodiment, and so will not be ex- 
plained further. 

The non-link destination content selection receiving 
unit 10510 has the user select a content to which a link 
is to be prohibited, and outputs the VEjd and NE_id of 
the selected content to a register provided in the data 
display control information editing apparatus. This user 
selection of a content can be made, for example, by in- 
dicating one of the icons representing contents on the 
content relation display unit 10040 using a selection 
pointer. 

The data updating unit 10520 updates the content 
of the data storage unit 1 0020 by resetting the valid pe- 
riod information for the sub-handler corresponding to 
the bytecode which represents the link to the content 
selected by the non-link destination content selection re- 
ceiving unit 10510, based on the indicated time received 
by the time input receiving unit 10010. 



As a result, the data updating unit 1 0520 resets the 
navigation information so that a sub-handler represent- 
ing a link to the selected content will be made invalid 
from the indicated time onwards. 

5 

Operation 

The following is an explanation of the operation of 
the data display control information editing apparatus 
w 10500 for the same specific data example as the sev- 
enth embodiment, with reference to Figs. 36, 38, and 39. 

Fig. 38 is a flowchart showing the operation of the 
data display control information editing apparatus 
10500 of the eighth embodiment. 

75 The steps in the flowchart in Fig. 38 which are the 
same as steps in the flowchart for the data display con- 
trol information editing apparatus 10000 of the seventh 
embodiment have been given the same reference nu- 
merals and will not be explained. The following expla- 

20 nation will instead focus on the processes in S1 0610 on- 
wards, and supposes that the display screen is as 
shown by display 10400 in Fig. 36. 

When the user selects icon 10420 representing a 
content, the non-link destination content selection re- 

25 ceiving unit 1 051 0 receives this selection and stores the 
NE jd and VE_id of the selected content in a register in 
the data display control information editing apparatus 
(S 10610). After a selection has been received by the 
non-link destination content selection receiving unit 

30 10510, the data updating unit 10520 refers to the 
Handle r_Part, the Bytecode_Part, and 
Hyperlink_lnformation_Part of the navigation informa- 
tion in the data storage unit 10020 based on the NE_id 
and VE_id in the register, and detects the sub-handler 

35 corresponding to the switching to the content selected 
by the user (S1 0620). The data updating unit 1 0520 then 
updates the ending time of the valid period of the de- 
tected sub-handler to the indicated time which was re- 
ceived by the time input receiving unit 10010 (S10630). 

40 When the user has selected the content with the 
NE_id-1 and the VE_id=1 , the data updating unit 1 0520 
refers to the Hyperlink_lnformation_Part 2176'of the 
navigation information 2170, and judges that the link 
with the link number "0" needs to be invalidated. The 

4S data updating unit 10520 then refers to the Bytecode 
Part 21 72 and the Handler_Part 21 73, detects the sub- 
handler "O" which corresponds to the bytecode "0" which 
describes the link to the link number "O", and resets the 
valid period of sub-handler "0" so that it ends at 14:59: 

50 00 on September 9, 1996. 

It should be noted that while the flowchart in Fig. 38 
only shows the processing as far as the updating of the 
valid period of a sub-handler (S10630), it is also possible 
for the processing to return to S1 01 70 or to S1 01 60 after 

55 the completion of S10630, so as to repeat the process- 
ing. By doing so, the user is then able to select another 
content so that the navigation information can be updat- 
ed to invalidate the link to this content from the indicated 
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time onwards. 

As described above, the data display control infor- 
mation editing apparatus of the eighth embodiment up- 
dates the navigation information based on the selection 
of a content by the user and an indication of time made s 
by the user, so that the link to the selected content be- 
comes invalid at the indicated time. 

The above first to eighth embodiments have been 
used to describe the data display control apparatus and 
data display control information editing apparatus of the 
present invention, although it should be clear that the 
present invention is not limited to these embodiments. 
Possible modifications are described below. 

(1 ) In the first to sixth embodiments, sets of instruc- 
tions are given as bytecodes, although a variety of 
instructions for a variety of processes may be used 
as the bytecodes. As one example, instructions re- 
lated to hardware operations, such as powering 
down the system, may be used. 

(2) In the first to sixth embodiments, information re- 
lating to time is set in units of one set of information 
for each handler, sub-handler, or set of graphics, al- 
though the same time information may be collec- 25 
tively set for a plurality of handlers, sub-handlers, 
and sets of graphics. 

(3) In the first to sixth embodiments, the contents 
were described as being composed of combina- 30 
tions of still images and on-screen display graphics, 
although contents may include video data and au- 
dio data. This video data and audio data may be 
multiplexed and transmitted by the data transmis- 
sion apparatus according to MPEG2 system stand- 35 
ard. 

(4) In the first to sixth embodiments, the navigation 
information was described as including a 
Graphics_Property_Part for indicating graphics, al- 40 
though the navigation information may also include 

an Audio_Property_Part that describes audio used 
as background music. Based on the 
Audio_Property_Part, the data display control ap- 
paratus may add audio to the display of contents. 45 

In such a case, information for the time at which 
audio reproduction is valid can be given as an ele- 
ment of the Audio_Property_Part, so that the con- 
trol of audio reproduction can be achieved based 
on an indicated time. so 

(5) The first and third embodiments describe an ex- 
ample where a handler is activated once an indicat- 
ed time is reached, although a handler written in a 
Time_Event_Part of the navigation information of a & 
new content may also be executed when content 
switching is performed if the display time written in 
the Time_Event_Part has already passed. Here, a 



plurality of pairings of times and handler numbers 
may be given in the Time_Event_Part. This may al- 
so be the same for the display of graphics in the 
fourth embodiment, so that when the indicated time 
has passed, the graphics may be changed to the 
display state corresponding to the indicated time. 



(7) The control based on time in the second to fifth 
embodiments may be control according to an 
elapsed time based on a certain standard timing, in 
the same way as the sixth embodiment where con- 
trol is performed according to elapsed time meas- 
ured from the start of display of a content. 

(8) The first to fifth, seventh, and eighth embodi- 
ments were described as handling expressions of 
time given in year, month, day, hour, minute, and 
second format, although they may instead handle, 
expressions of time in year format, year and month 
format, year, month and day format, year, month 
day, and hour format, year, month, day, hour and 
minute format, or in a format that uses units that are 
smaller than one second. 

(9) The first to sixth embodiments describe the case 
where a VE_id is given as an element in the 
HyperlinkJnformation_Part, although a combina- 
tion of a PI D and a stream_id may be used instead 
of the VEjd. When doing so, when content switch- 
ing is indicated by a user operation, the data display 
control apparatus 1000 may set the appropriate PID 
and other information in the filter condition storage 
unit 1021 and so have the image data separated 
from the transmitted transport stream. 

(10) In the sixth embodiment, the measuring of the 
elapsed time was achieved by a timer provided in 
the data display control apparatus, although it is al- 
so possible for the data display control apparatus 
to keep time by receiving present time information 
in the same way as in the first to fifth embodiments. 
When doing so, the data transmission apparatus 
will transmit present time information in the same 



(6) The acquisition of the present time by the data 
display control apparatuses of the first to fifth em- 
10 bodiments was described as the reception of trans- 
mitted data that expresses the present time, al- 
though each data display control apparatus may be 
provided with a timer mechanism from which the da- 
ta display control apparatus can obtain the present 
time. It should be noted here that the correction for 
a time difference in such case will be a correction 
of the difference between the standard time given 
in the transmitted navigation information and the 
standard time of the present time obtained by the 
20 data display control apparatus from the timer mech- 
anism. 
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way as in the first to fifth embodiments, 

(11) In the first to eighth embodiments, the input 
method for receiving user operations may be 
achieved using a remote controller, a mouse, or any 5 
other kind of input device. 

(12) In the seventh and eighth embodiments, the 
user input of the time indication is described as a 
direct input of time made using a keyboard, al- 10 
though an indirect input may be made by having the 
user select one of a plurality of potential values dis- 
played on the display screen. 

(13) In the seventh and eighth embodiments, the is 
links between contents were described as being 
represented by broken lines and solid lines drawn 
between contents, although other forms of repre- 
sentation may be used. As one example, links that 
are not valid at the indicated time may be drawn us- 20 
ing transparent lines, which is to say the contents 
may be displayed as not being linked. Any kind of 
image may also be used as the icons for displaying 

the contents. The icons used for displaying link des- 
tination contents may also be displayed in a manner 25 
that distinguishes between link destinations which 
are valid at the indicated time and link destinations 
which are not valid. 

(14) In the seventh and eighth embodiments, the 30 
interrelations between contents were displayed 
based on a detection of links performed by byte- 
codes that are "GotoPage", although it is also pos- 
sible to display the interrelations of the display 
states of contents by detecting instructions that 35 
change display states, such as "SetGraphic Visibil- 
ity" instructions. 

(15) In the eighth embodiment, the valid period of a 
sub-handler that corresponds to a bytecode which 40 
achieves a link to the content indicated by the user 

is updated, although it is also possible for the time 
of the control for a change in the display state of 
graphics corresponding to the sub-handler to be 
changed, so that the display state becomes "invis- 45 
ible" at a certain time. Here, however, a data storage 
unit 10020 for storing the navigation information 
with the data construction shown in the fourth em- 
bodiment becomes necessary. 

50 

(16) In the seventh and eighth embodiments, the 
data display control information editing apparatus 
displays the interrelations between contents at a 
time indicated by the user, with the navigation infor- 
mation showing the states of contents at the indi- ss 
cated time being the same as the navigation infor- 
mation described in the first embodiment. However, 
this display of the interrelations between contents 



may be performed using the same navigation infor- 
mation as in any of the second to fifth embodiments. 

(17) The processing of the reception control unit 
1050 of the data display control apparatus in the first 
to sixth embodiments (shown in the flowcharts in 
Figs. 1 4, 20, 23, 25, 28, and 32) and the processing 
of the data display control information editing appa- 
ratuses 10000 and 10500 in the seventh and eighth 
embodiments (shown in the flowcharts in Figs. 35 
and 38) may be achieved by computer programs 
written in machine language, with recording media 
storing these programs being distributed and sold. 
These recording media can be IC cards, optical 
discs, floppy discs, ROMs, or other media, with the 
machine language program recorded on the media 
being installed into standard hardware. This stand- 
ard hardware can be a conventional personal com- 
puter which executes the installed machine lan- 
guage program, thereby realizing the data display 
control apparatus of any of the first to sixth embod- 
iments or the data display control information edit- 
ing apparatus of the seventh or eighth embodi- 
ments. 

/ 

Although the present invention has been fully de- 
scribed by way of examples with reference to accompa- 
nying drawings, it is to be noted that various changes 
and modifications will be apparent to those skilled in the 
art. Therefore, unless such changes and modifications 
depart from the scope of the present invention, they 
should be construed as being included therein. 



Claims 

1 . A data display control apparatus for receiving a plu- 
rality of sets of multimedia data and a set of time 
control information, and for controlling the display 
of the sets of multimedia data, the plurality of sets 
of multimedia data composing a plurality of contents 
which make up a broadcast program, and the set of 
time control information being used for controlling a 
display of the sets of multimedia data, 

the data display control apparatus comprising; 
data storage means; 

receiving means for extracting at least one set 
of multimedia data and the set of time control 
information from data transmitted from a broad- 
. cast program transmission apparatus and stor- 
ing the received sets of multimedia data and the 
set of time control information into the data stor- 
age means; 

current time information obtaining means for 
obtaining a set of current time information in- 
cluding an expression of a current time; 
time information judging means for judging 



32 



63 



EP0 830 019 A2 



64 



whether control relating to a display of the sets 
of multimedia data is possible by comparing the 
set of current time information with the set of 
time control information; and 
display control means for controlling the display s 
of the sets of multimedia data based on a judg- 
ing result of the time information judging 
means. 

2. The data display control apparatus of Claim 1, 10 
wherein 

the set of time control information is repeat- 
edly transmitted by the broadcast program trans- 
mission apparatus. 

15 

3. The data display control apparatus of Claim 1 , fur- 
ther comprising: 

link instruction receiving means for receiving an 
instruction input by a user which specifies a 20 
new content to be displayed; and 
link instruction executing means for displaying 
the new content according to the instruction re- 
ceived by the link instruction receiving means. 

25 

4. The data display control apparatus of Claim 1, 
wherein 

the receiving means also extracts the set of cur- 
rent time information from the data transmitted 30 
from the broadcast program transmission ap- 
paratus, and 

the current time information obtaining means 
obtains the current time information from the re- 
ceiving means. 35 

5. The data display control apparatus of Claim 1, 
wherein 

the data storage means stores a time difference 40 
value which indicates a time difference be- 
tween the expression of the current time in the 
set of current time information and a standard 
control time in the set of time control informa- 
tion, and 45 
the control judging means refers to the time dif- 
ference value and corrects a content of the cur- 
rent time information using the time difference 
when comparing the set of current time infor- 
mation with the set of time control information, so 

6. The data display control apparatus of Claim 5, 
wherein 

the receiving means extracts the time differ- ss 
ence value and the set of current time informa- 
tion from the data transmitted from the broad- 
cast program transmission apparatus and stor- 



ing the extracted time difference value in the 
data storage means, and 
the current time information obtaining means 
obtains the set of the current time information 
from the receiving means. 

7. A data display control apparatus for receiving a plu- 
rality of sets of multimedia data that compose a plu- 
rality of contents which make up a broadcast pro- 
gram, and for controlling a display of the sets of mul- 
timedia data, the data display control apparatus 
comprising: 

data storage means; 

receiving means for extracting, from data trans- 
mitted from a broadcast program transmission 
apparatus, the plurality of sets of multimedia 
data, at least one instruction for executing a 
certain operation, and at least one set of time 
control information for controlling execution of 
at least one related instruction, the receiving 
means storing the separated sets of multimedia 
data, instructions, and sets of time control in- 
formation into the data storage means 
current time information obtaining means for 
obtaining a set of current time information in- 
cluding an expression of a current time; 
time information judging means for judging 
whether execution of an arbitrary instruction is 
possible by comparing the set of current time 
information with a set of time control informa- 
tion related to the arbitrary instruction; 
display control means for executing the arbi- 
trary instruction based on a judging result of the 
time information judging means; 
link instruction receiving means for receiving an 
instruction input by a user which specifies a 
content to be displayed; and 
link instruction executing means for displaying 
the content according to the instruction re- 
ceived by the link instruction receiving means. 

8. The data display control apparatus of Claim 7, 
„ wherein the instructions are instructions that control 

a display of the sets of multimedia data. 

9. A data display control apparatus for receiving a plu- 
rality of sets of multimedia data and a plurality of 
sets of time control information, and for controlling 
the display of the sets of multimedia data, the plu- 
rality of sets of multimedia data composing a plural- 
ity of contents which are elements of a broadcast 
program, each of the plurality of sets of time control 
information being related to a set of multimedia data 
and being used for controlling a display of the relat- 
ed set of multimedia data, 

the data display control apparatus comprising: 
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data storage means; 

receiving means for extracting at least one set 
of multimedia data and at least one set of time 
control information from data transmitted from 
a broadcast program transmission apparatus s 
and for storing the sets of multimedia data and 
the sets of time control information into the data 
storage means; 

current time information obtaining means for 
obtaining a set of current time information in- 10 
eluding an expression of a current time; 
time information judging means for judging 
whether control relating to a display of an arbi- 
trary set of multimedia data is possible by com- 
paring the set of current time information with is 
a set of time control information related to the 
arbitrary set of multimedia data; 
display control means for controlling the display 
of the arbitrary set of multimedia data based on 
a judging result of the time information judging 20 
means; 

link instruction receiving means for receiving an 
instruction input by a user which specifies a 
content to be displayed; and 
link instruction executing means for displaying 25 
the content according to the instruction re- 
ceived by the link instruction receiving means. 

1 0, A data display control apparatus for receiving a plu- 
rality of sets of multimedia data and a plurality of so 
sets of time control information and controlling dis- 
play of the sets of multimedia data, wherein the plu- 
rality of sets of multimedia data compose a plurality 
of contents which make up a broadcast program, 
and each set of time control information corre- 35 
sponds one of the plurality of contents, 

the data display control apparatus comprising: 
data storage means; 

receiving means for extracting at least one set 40 
of multimedia data and at least one set of time 
control information from data transmitted from 
a broadcast program transmission apparatus 
and storing the sets of multimedia data and the 
sets of time control information into the data 45 
storage means; 

current time information obtaining means for 
obtaining a set of current time information in- 
cluding an expression of a current time; 
link instruction receiving means for receiving an so 
instruction input by a user which specifies a 
content to be displayed; 
link instruction executing means for displaying 
the content according to the instruction re- 
ceived by the link instruction receiving means; & 
time information judging means for judging, 
when the link instruction executing means dis- 
plays the content, whether control relating to a 



display of the content is possible by comparing 
the set of current time information with a set of 
time control information related to the displayed 
content; and 

display control means for controlling the display 
of the content based on a judging result of the 
time information judging means. 

11 . A data display control apparatus for receiving a plu- 
rality of sets of multimedia data, at least one instruc- 
tion, and one set of time control information related 
to each instruction, and for controlling display of the 
sets of multimedia data by executing the instruc- 
tions, wherein the plurality of sets of multimedia da- 
ta compose a . plurality of contents which make up a 
broadcast program, and wherein each set of time 
control information is used for controlling execution 
of the related instruction, 

the data display control apparatus comprising: 
data storage means; 

receiving means for extracting at least one set 
of multimedia data, at least one instruction, and 
at least one set of time control information from 
data transmitted from a broadcast program 
transmission apparatus and' storing the re- 
ceived sets of multimedia data! the received in- 
structions, and received sets of time control in- 
formation into the data storage means; 
current time information obtaining means for 
obtaining a set of current time information in- 
cluding an expression of a current time; 
time information judging means for judging 
whether an execution of an arbitrary instruction 
is possible by comparing the set of current time 
information with a set of time control informa- 
tion related to the arbitrary instruction; 
display control means for executing the arbi- 
trary instruction based on a judging result of the 
time information judging means; 
link instruction receiving means for receiving an 
instruction input by a user which specifies a 
content to be displayed; and 
link instruction executing means for displaying 
the content according to the instruction re- 
ceived by the link instruction receiving means. 

12. The data display control apparatus of Claim 11, 
wherein 

the sets of time control information are also re- 
lated to the contents, and 
the display control means executes the arbi- 
trary instruction when a content related to the 
set of time control information compared by the 
time information judging means is being dis- 
played. 
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13. The data display control apparatus of Claim 11, 
wherein 

each set of time control information indicates 
an absolute control time and the set of current s 
time information includes an absolute current 
time as the expression of a current time, and 
the time information judging means judges that 
execution of the arbitrary instruction is possible 
when the control time is equal to or earlier than 10 
the absolute current time. 

14. The data display control apparatus of Claim 11, 
wherein 

15 

each set of time control information indicates a 
control elapsed time and the set of current time 
information indicates an elapsed time from a 
start of a display of a current content as the ex- 
pression of a current time, and 20 
the time information judging means judges that 
execution of the arbitrary instruction is possible 
when the elapsed time is equal to or greater 
than the control elapsed time in a set of time 
control information for the arbitrary instruction. 25 

15. A data display control apparatus for receiving a plu- 
rality of sets of multimedia data, at least one instruc- 
tion, and at least one set of time control information, 
and for controlling display of the sets of multimedia 30 
data, wherein the plurality of sets of multimedia data 
compose a plurality of contents which make up a 
broadcast program, wherein the instructions are 
used to control a display of the sets of multimedia 
data, and wherein each set of time control informa- 35 
tion is used for controlling execution of a related in- 
struction and is also related to a grouping of sets of ' 
multimedia data, 

the data display control apparatus comprising: 40 
data storage means; 

receiving means for extracting, from data trans- 
mitted from a broadcast program transmission 
apparatus, at least one set of multimedia data, 
at least one instruction, at least one set of time <s 
control information, and a set of identification 
information for a grouping of sets of multimedia 
data, and for storing the sets of multimedia da- 
ta, the received instructions, the received set of 
time control information, and the received set so 
of identification information into the data stor- 
age means; 

current time information obtaining means for 
obtaining a set of current time information for a 
current time; 55 
time information judging means for judging 
whether execution of an arbitrary instruction is 
possible by comparing the set of current time 



information with a set of time control informa- 
tion related to the arbitrary instruction; 
display control means for referring to the re- 
ceived set of identification information, and, 
when a set of multimedia data belonging to the 
grouping of sets of multimedia data identified 
by the set of identification information is being 
displayed, executing the arbitrary instruction 
based on a judging result of the time informa- 
tion judging means; 

link instruction receiving means for receiving an 
instruction input by a user which specifies a 
content to be displayed; and 
link instruction executing means for displaying 
the content according to the instruction re- 
ceived by the link instruction receiving means. 

16. A data display control apparatus for receiving a plu- 
rality of sets of multimedia data, at least one instruc- 
tion, and at least one set of time control information, 
and controlling a display of the sets of multimedia 
data according to an operation indication input by a 
user, wherein the plurality of sets of multimedia data 
compose a plurality of contents which make up a 
broadcast program, the instructions control a dis- 
play of the sets of multimedia data, and each set of 
time control information relates toian execution of 
an instruction, 

the data display control apparatus comprising: 
data storage means; 

receiving means for extracting at least one set 
of multimedia data, at least one instruction, and 
at least one set of time control information from 
data transmitted from a broadcast program 
transmission apparatus and storing the re- 
ceived sets of multimedia data, the received in- 
structions, and the received sets of time control 
information into the data storage means; 
current time information obtaining means for 
obtaining a set of current time information for a 
current time; 

operation-indication receiving means for receiv- 
ing the operation indication input by the user; 
time information judging means for judging, 
when the operation indication receiving means 
receives the operation indication, whether ex- 
ecution of an arbitrary instruction is possible by 
comparing the set of time control information 
related to the arbitrary instruction with the set 
of current time information; and . 
display control means for executing the arbi- 
trary instruction based on the judging result of 
the time information judging means. 

17. A data transmission apparatus for transmitting a 
plurality of sets of multimedia data, wherein the plu- 
rality of sets of multimedia data compose a plurality 
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of contents which make up a broadcast program, 
the data transmission apparatus comprising: 

transmission data storage means for storing 
the plurality of sets of multimedia data and a set s 
of time control information used for controlling 
display of the plurality of sets of multimedia da- 
ta; and 

transmission means for transmitting the plural- 
ity of sets of multimedia data and the set of time 10 
control information. 

18. The data transmission apparatus of Claim 17, 
wherein 

the transmission means repeatedly transmits 1$ 
the set of time control information. 

19. The data transmission apparatus of Claim 17, 
wherein 

20 

the transmission data storage means further 
stores a set of link information which shows in- 
terrelations between contents in the plurality of 
contents, and 

the transmission means also transmits the set 25 
of link information. 

20. The data transmission apparatus of Claim 17 fur- 
ther comprising: 

30 

time measuring means for measuring a current 
time, wherein 

the transmission means further transmits a set 
of current time information showing the current 
time. 35 

21. The data transmission apparatus of Claim 17, 
wherein 

the transmission data storage means stores a 40 
time difference value which indicates a time dif- 
ference between the current time and a stand- 
ard control time in the set of time control infor- 
mation, and 

the transmission means further transmits the 45 
time difference value. 

22. A data transmission apparatus for transmitting a 
plurality of sets of multimedia data, wherein the plu- 
rality of sets of multimedia data compose a plurality so 
of contents which make up a broadcast program, 

the data transmission apparatus comprising: 

transmission data storage means for storing 
the plurality of sets of multimedia data, at least 55 
one instruction for executing a certain opera- 
tion, at least one set of time control information 
for controlling an execution of a related instruc- 



tion, and a set of link information which shows 
interrelations between contents in the plurality 
of contents; and 

transmission means for transmitting the plural- 
ity of sets of multimedia data, the instructions, 
the sets of time control information, and the set 
of link information. 

23. The data transmission apparatus of Claim 22, 
wherein 

each of the instructions controls a display of 
a set of multimedia data. 

24. A data transmission apparatus for transmitting a 
plurality of sets of multimedia data, wherein the plu- 
rality of sets of multimedia data compose a plurality 
of contents which make up a broadcast program, 
the data transmission apparatus comprising: 

transmission data storage means for storing 
the plurality of sets of multimedia data, a plu- 
rality of sets of time control information that 
each correspond to one set of multimedia data 
and are used to control a display of a corre- 
sponding set of multimedia data, and a set of 
link information which shows interrelations be- 
tween contents in the plurality !of contents; and 
transmission means for transmitting the plural- 
ity of sets of multimedia data, the plurality of 
sets of time control information, and the set of 
link information. 

25. A data transmission apparatus for transmitting a 
plurality of sets of multimedia data, wherein the plu- 
rality of sets of multimedia data compose a plurality 
of contents which make up a broadcast program, 
the data transmission apparatus comprising: 

transmission data storage means for storing 
the plurality of sets of multimedia data, a plu- 
rality of sets of time control information that 
each correspond to one content and are used 
to control a display of a corresponding content, 
and a set of link information which shows inter- 
relations between contents in the plurality of 
contents; and 

transmission means for transmitting the plural- 
ity of sets of multimedia data, the plurality of 
sets of time control information, and the set of 
link information. 

26. A data transmission apparatus for transmitting a 
plurality of sets of multimedia data, wherein the plu- 
rality of sets of multimedia data compose a plurality 
of contents which make up a broadcast program, 
the data transmission apparatus comprising: 

transmission data storage means for storing, 
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the plurality of sets of multimedia data, at least 
one instruction for controlling display of the sets 
of multimedia data, at least one set of time con- 
trol information for automatically starting an ex- 
ecution of a related instruction; and a set of link 5 
information which shows interrelations be- 
tween contents in the plurality of contents; and 
transmission means for transmitting the plural- 
ity of sets of multimedia data, the instructions, 
the sets of time control information, and the set 10 
of link information. 

27. The data transmission apparatus of Claim 26, 
wherein 

each set of time control information indicates is 
a control time which is an indicated time. 

28. The data transmission apparatus of Claim 26, 
wherein 

each set of time control information indicates 20 
a control elapsed time showing an elapsed time 
from a start of display of a predetermined content. 

29. A data transmission apparatus for transmitting a 
plurality of sets of multimedia data, wherein the plu- 25 
rality of sets of multimedia data compose a plurality 

of contents which make up a broadcast program, 
the data transmission apparatus comprising: 

transmission data storage means for storing 30 
the plurality of sets of multimedia data, at least 
one instruction for controlling a display of the 
sets of multimedia data, at least one set of time 
control information, and a set of link information 
which shows interrelations between contents in 35 
the plurality of contents, wherein each set of 
time control information is composed of time in- 
formation for an automatic start of execution of 
one of the instructions and is related to a group- 
ing of sets of multimedia data; and 40 
transmission means for transmitting the plural- 
ity of sets of multimedia data, the instructions, 
the sets of time information, and the set of link 
information. 

45 

30. A data transmission apparatus for transmitting a 
plurality of sets of multimedia data, wherein the plu- 
rality of sets of multimedia data compose a plurality 
of contents which make up a broadcast program, 

the data transmission apparatus comprising: so 

transmission data storage means for storing 
the plurality of sets of multimedia data, at least 
one instruction for controlling a display of the 
sets of multimedia data, at least one set of time 55 
control information which is used as a criterion 
by a reception apparatus in judging whether to 
execute a related instruction; and a set of link 



information which shows interrelations be- 
tween contents in the plurality of contents; and 
transmission means for transmitting the plural- 
ity of sets of multimedia data, the instructions, 
the sets of time control information, and the set 
of link information. 

31. A data display control information editing apparatus 
for displaying interrelations between a plurality of 
contents on a display screen and for editing, in ac- 
cordance with a user operation, sets of time-related 
information that are used for controlling the interre- 
lations, 

the data display control information editing ap- 
paratus comprising: 

data storage means for storing a plurality of 
pairings of a set of link information and a set of 
valid period information and storing a set of 
content control information, wherein each set 
of link information indicates a change in display 
from a first content to a second content, each 
set of valid period information indicates a valid 
period of a corresponding set of link informa- 
tion, and the set of content control information 
is used for controlling display and processing 
of contents; ' 
time receiving means for receiving an indicated 
time input by a user; and 
content relation displaying means for display- 
ing interrelations between contents at the indi- 
cated time received by the time receiving 
means, based on the pairings of a set of link 
information and a set of valid period information 
which has a valid period that includes the indi- 
cated time received by the time receiving 
means. 

32. The data display control information editing appa- 
ratus of Claim 31 , further comprising: 

content specification receiving means for re- 
ceiving a specification of a content input by a 
user; and 

link information updating means for updating a 
set of valid period information of a set of link 
information which indicates a change in display 
to the content specified by the user so that the 
set of link information is made invalid at the in- 
dicated time received by the time receiving 
means. 

33. The data display control information editing appa- 
ratus of Claim 32, wherein 

the sets of link information and the sets of val- 
id period information are transmitted from a trans- 
mission apparatus used in a digital broadcast sys- 
tem to a data display control apparatus which dis- 
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plays contents. 

34. A recording medium on which a data display control 
program is recorded, the data display control pro- 
gram controlling a data display control apparatus 
which receives a plurality of sets of multimedia data 
and a set of time information and controls display 
of the sets of multimedia data using the set of time 
control information, wherein the plurality of sets of 
multimedia data compose a plurality of contents 
which make up a broadcast program, the data dis- 
play control program comprising the steps of: 

obtaining a set of current time information for a 
current time; 

judging whether control should be performed 
by the data display control apparatus to display 
the sets of multimedia data by comparing the 
set of current time information with the set of 
time control information; and 
having the data display control apparatus con- 
trol a display of the sets of multimedia data 
based on a judging result of the judging step. 



the data display control information editing pro- 
gram comprising the steps of: 
instructing the data display control information 
editing apparatus to receive an input of an in- 

s dicated time from a user; and 

referring to content control information for con- 
trolling a display of a content and execution of 
a predetermined process and to sets of link in- 
formation that each indicate a switching of dis- 

10 play from a first content to a second content, 

and instructing the data display control informa- 
tion editing apparatus to display interrelations 
between pairs of contents on the display screen 
at the indicated time, based on the sets of link 

is information that are valid at the indicated time. 



35. A recording medium on which a data display control 25 
program is recorded, the data display control pro- 
gram controlling a data display control apparatus 
which receives a plurality of sets of multimedia data, 
at least one instruction, and at least one set of time 
control information related to each instruction, and 30 
controls a display of the sets of multimedia data us- 
ing the instructions, the plurality of sets of multime- 
dia data composing a plurality of contents which 
make up a broadcast program, and each set of time 
control information being used for controlling an ex- 35 
ecution of the related instruction, 



the data display control program comprising the 
steps of: 

obtaining a set of current time information for a 40 
current time; 

judging whether an arbitrary instruction should 
be executed by the data display control appa- 
ratus by comparing the set of current time in- 
formation with a set of time control information 4$ 
related to the arbitrary instruction; 
having the arbitrary instruction executed by the 
data display control apparatus based on a judg- 
ing result of the judging step. 

50 

36. A recording medium on which a data display control 
information editing program is recorded, the data 
display control information editing program control- 
ling a data display control information editing appa- 
ratus which displays interrelations between con- 55 
tents on a display screen and edits a set of time in- 
formation used for controlling the interrelations, 



38 



EP0 830 019 A2 




39 



EP0 830 019 A2 



FIG. 2 



220 



VIDEO 



T 



-"^ooooo" 



MENU 

r 

221 



MAILORDER 



VIDEO 




STEREO 




STEREO 



230 



O 
o 



¥100000 



O 
o 



MENU 

r 

231 



40 



EP0 830 019 A2 




41 




42 



EP0 830 019 A2 




43 



EP0 830 019 A2 



FIG. 6 



NE id 



0 I 



216 



Bytecode_Part 



BYTE CODE NO. 


BYTE CODE 


0 


PushLO.GotoPage 


1 


PushLl.GotoPage 



Handler Part 



HANDLER NO. 


BYTE CODE NO. 


0 


0 


1 


1 



Graphics_Property_Fart 



GRAPHICS NO. 


TYPE 


COORDINATES 


HANDLER NO. 


initial state 


0 


BUTTON 


(20,20) 


0 


Visible 


1 


BUTTON 


20,60 


1 


Visible 



Bitmap_lnformation_Part 



NUMBER 


0 


1 


aWIEHT 






VIDEO 


STEREO 







Hyperlink_Information_Part 



.301 



.302 



v 



303 



,304 



LINK NO. 


LINK DESTINATION MATERIAL ID 


0 


NE_id=l, VE id=l 


1 


NE_id=2, VE_id=2 



J 



305 



44 



EP 0 830 019 A2 



oo 

I 

-< 

O 
Q£ 

O 



GO 

Q 
Q 



O 

o 
o 



\ 



d 



o 
o 



o 

CO 

o 



CO 

o 



< 

sib 



o 
oo 
o 



\ 



Q 
O 

o 
> 
< 



O 
O 

CJ) 



o 

CD 
O 



M 



o 

CM 

o 



E— 
ZD 

*3 
o 

o 

-<: :=> 



O 

o 
:=> 

Q 
O 

OS 3 



\ 




C\3 
O 

r 



o 
o 



\ 



o 



Oil 

w Hi 



/ 



o 
o 



O 

w 
o 



1— J 




45 



EP0 830 019 A2 



FIG. 8 



2400 



2200 



VIDEO 



¥2ooooa 



MENU 



.2210 



MAILORDER 



VIDEO 




STEREO 



2410 




2420 



1996.9.9,15:00:00| 



THIS OFFER IS 
NO LONGER VALID 



2430 



2300 



STEREO 



O 
o 



¥10000(7 



O 
o 



MENU 



2130 



2310 



2131 



46 




47 



EP0 830 019 A2 




48 



EP 0 830 019 A2 



FIG. 1 1 



NE_id | 0 | 



2160 



Time EventPart 



ACTIVATE TIME 


HANDLER NO. 


1996.9.9,15 : 00 : 00 


2 



BytecodeJPart 



BYTECODE NO. 


BYTECODE 


0 


PushLO.GotoPage 


1 


PushLl.GotoPage 


2 


PushL2,PushL 1 .SetGraphicVisibility . 
PushLO.PushLO.SetGraphicVisibility, 
PushL 1 .PushLO.SetGraphicVisibility 



Handler_Part 



HANDLER NO. 


BYTECODE NO. 


0 


0 


1 


1 


L 


1 



Graphics_Property_Fart 



GRAPHICS NO. 


TYPE 


COORDINATES 


HANDLERNO. 


MITIALSTATE 


0 


BUTTON 


(20.20) 


0 


Visible 


1 


BUTTON 


(20,60) 


1 


Visible 


2 


BUTTON 


( 0.20) 


NONE 


Invisible 



Bitmap_Information_Part 




iMBER 


0 


1 


2 


OTIM 


VIDEO 


STEREO 


THIS OFFER IS. 
NO LONGER VALID 







Hyperlink_Information_Part 



LINK NO. 


LINK DESTINATION MATERIAL ID 


0 


NE id=l,VE id=l 


1 


NE_id=2, VE_id=2 



,2161 



,2162 



,2163 



2164 



,2165 



,2166 



49 



EP0 830 019 A2 



FIG. 12 



NE_id | 1 ~) 



Time_Event_Part 

NOT WRITTEN 



Bytecode_Part 



Handler Part 



HANDLER NO. 


BYTECODENO. 


0 


0 



Graphics_Property_Part 



,2260 



,2261 



BYTECODENO. 


BYTECODE 


0 


PushLO.GotoPage 



-2262 



GRAPHICS NO. 


TYPE 


COORDINATES 


1ANDLERN0. 


INITIAL STATE 


0 


BUTTON 


(20,60) 


0 


Visible 



,2263 



,2264 



Bitmap_Information_Part 



NUMBER 


0 


CONTEWT 




MENU 





,2265 



Hyperlink_Information_Part 



LINK NO. 


LINK DESTINATION MATERIAL ID 


0 


NE_id=0, VE_id=0 



r 



^2266 



50 



EP0 830 019 A2 



FIG. 13 



NE_id [ 2 ~1 



Time_Event_Part 

NOT WRITTEN 



Bytecode_Part 



Handler Part 



HANDLER NO. 


BYTECODENO. 


0 


0 



Graphics_Property_Part 



2360 



/2361 



BYTECODENO. 


BYTECODE 


0 


PushLO.GotoPage 



2362 



GRAPHICS NO. 


TYPE 


COORDINATES 


HANDLERNO. 


INITIAL STATE 


0 


BUTTON 


(20,60) 


0 


Visible 



2363 



2364 



Bitmap_Information_Part 



NUMBER 


0 


coier 




MENU 





2365 



Hyperlink_Information_Part 



LINK NO. 


LINK DESTINATION MATERIAL ID 


0 


NE_id=0. VE_id=0 



,2366 



51 



EP0 830 019 A2 



FIG. 14 




START 



S3010 



FIRST CONTENT INDICATED I "" 

,S3020 






NO 










SELECTION POINTER MOVED 


IN ACCORDANCE WITH USER INPUT 



PRESENT TIME OBTAINED | 



XS3090 



ADjUSTMEffT FOR TIME DIFFERENCE! 





S3130 



52 



EP0 830 019 A2 



FIG. 15 



TIME 



DISPLAY SCREEN 



1996.9.9 
14 : 57 : 00 




1996.9.9 
14 : 58 : 00 




1996.9.9 
14 : 59 : 00 




1996.9.9 
15 : 00 : 00 



THIS OFFER IS 
NO LONGER VALID 



53 



EP0 830 019 A2 



FIG. 16A 



TDT 



PRESENT TIME 
(1996:09:09:14:57:00) 



4010 



FIG. 16B 



TOT 



PRESENT TIME(1996:09:09: 14:57:00) 


COUNTRY ID CODE 
(U.K.) 


TIME DIFFERENCE 
(+00:00:00) 


COUNTRY ID CODE 
GAP AN) 


TIME DIFFERENCE 
(+09:00:00) 







,4020 



54 



EP0 830 019 A2 



FIG. 17 



NE id 



Time_Event_Part 



NOT WRITTEN 



BytecodeJPart 



BYTEC0DEN0. 


BYTECODE 


0 


PushLO.GotoPage 


1 " 


PushLl.GotoPage 


2 


PushL2,PushLl . SetGraphic Viability . 
PusHO.PushLO.SetGraphicViability, 
PushL 1 ,PushLO,SetGraphicVisibiJlty 



Handler_Part 



1ANDLERN0. 


SUBHANDLERNO. 


VAUD PERIOD 


0 


U 


-Majtitisjs 


2 




1 


1 




2 


mmmir- 



SOBHANDLERNO. 


BY1EC0DEN0. 


0 


0 


1 


1 


2 


2 



Graphics_Froperty_Part 









0 


BUTTON 


(20,20) 


0 


Visible 


l 


BUTTON 


(20,80) 


1 


Visible 


2 


BUTTON 


{ 0.20) 


NONE 


Invisible 



Bitmap_Information_Part 




NUMBER 


0 


1 


2 


mm 


VIDEO 


STEREO 


THIS OFFER IS 
NO LONGER VALID 







Hyperlink__Information_Part 



r 



LINK NO. 


LINK DESTINATION MATERIAL ID 


0 


NE id=l, VE id=l 


1 


m id=2,VE id=2 



2170 



2171 



,2172 



2173 



2174 



,2175 



,2176 



55 



EP0 830 019 A2 



FIG. 18 



NE_id 



HI 



,2270 



Time_Event_Part 

NOT WRITTEN 



.2271 



Bytecode_Part 



BYTEC0DEN0. 


BYTECODE 


0 


PushLO.GotoPage 



2212 



Handler Part 



HANDLER NO. 


SUBHANDLERNO. 


VAUDPER10D 


0 


0 





SUBHANDLERNO. 


BYTECODENO. 


0 


0 



Graphics_Property_Part 



GRAPHICS NO. 


TYPE 


COORDINATES 


HANDLER NO. 


INITIAL STATE 


0 


BUTTON 


(20.60) 


0 


Visible 



-2273 



Bitmap_Information_Part 



NUMBER 


o 


mm 




MENU 





,2215 



Hyperlink_Information_Part 



LINK NO. 


LINK DESTINATION MATERIAL ID 


0 


NE_id=O.VE_id=0 



,2276 



56 



EP0 830 019 A2 



FIG. 19 



NE id 



ZZL 



Time_Event_Part 

NOT WRITTEN 



Bytecode_Part 



Handler Part 



HANDLER NO. 


SUBHANDLERNO. 


VMER10D 


0 


0 





Graphics^PropertyJPart 



2370 



2371 



BYTECODENO. 


BYTECODE 


0 


PushLO.GotoPage 



2372 



SUBHANDLERNO. 


BYTECODENO. 


0 


0 



2373 



GRAPHICS NO. 


TYPE 


COORDINATE 


HANDLER NO. 


INITIAL STATE 


0 


BUTTON 


(20.60) 


0 


Visible 



/ 237 4 



Bitmap JWormationJPart 



NUMBER 


0 


CONTENT 




MENU 





2375 



Hyperlink_Information_Part 



LINK NO. 


LINK DESTINATION MATERIAL ID 


0 


NE_id=0, VE_id=0 



2376 



57 



EP 0 830 019 A2 



FIG. 20 



(handler activated) 
present time obtained p s3131 



ADJUSTMENT FOR TIME DIFFERENCE^ S3 1 32 




S3133 



S3 135 



BYTECODE CORRESPONDING TO 
PRESENT SUB-HANDLER EXECUTED 




YES 



S3137 



NEXT SUB-HANDLER 
SELECTED 



HANDLER PROCESSING 
^COMPLETED 



J 



58 



EP0 830 019 A2 



CO 
CO 



A. 



o 

CO 
CO 
CO 



00 

d 



2 
o 

H 
< 

o 

CO 

2 

s 

o 

CO 

< 

-J 

D-. 

CO 
i — i 

Q 



O 
w 
Q 

> 



i] 



8 

o 
o 
o 

CO 



ID 

2 
w 



o 
o 

CM 



Q 
O 



o 




o 


w 




§ 


Q 






> 




oo 



o 
o 

CM 




CO 
CD 



O 
O 



OO 

in 



CD 
CD 



O 
O 



. O 



59 



EP 0 830 019 A2 



FIG. 22 



NE id 



2180 



Time_Event_Part 



ACTIVATE TIME 


HANDLER NO. 


GRAPHICS NO. 


1996.9.9,15 : 00 : 00 


2 


0,1 



r 



2181 



Bytecode_Part 




BYTECODE NO. 


BYTECODE 




0 


PushLO.GotoPage 




1 


PushLl.GotoPage 




2 


PushL2,PushLl,SetGraphicVisibility, 
PushLO.PushLO.SetGraphicVisibility. 
PushLl .PushLO.SetGraphicVisibility 




Handler.Part 








HANDLER NO. 


BYTECODE NO. 






0 


0 






1 


1 






2 


2 





,2182 



,2m 



Graphics_Froperty_rart 



GRAPHICS NO. 


TYPE 


COORDINATE} 


HANDIM. 


NI1TAL STATE 


0 


BUTTON 


(20.20) 


0 


Visible 


1 


BUTTON 


(20,60) 


1 


Visible 


2 


BUTTON 


( 0,20) 


NONE 


Invisible 



-2184 



Bitmap_Information_Part 



NUMBER 


0 


1 


2 


GGNIBiT 


VIDEO 


STEREO 


THIS OFFER IS 
NO LONGER VALID 







2185 



Hyperlink_Information_Part 



LINK NO. 


LINK DESTINATION MATERIAL ID 


O 


NE id=l, VE id=l 


1 


NE id=2, VE id=2 



,2186 



60 



EP0 830 019 A2 



FIG. 23 




START 



FIRST CONTENT INDICATED \ 



S5010 



S5020 




S5090 



61 



EP0 830 019 A2 



FIG. 24 



NE id 



6160 



Bytecode_Part 



BYTEC0DEN0. 


BYTECODE 


0 


PushLO.GotoPage 


1 


PushLl.GotoPage 



j 



6162 



Handler Part 



HANDLER NO. 


BYTECODE NO. 


U 


0 


1 


1 



§163 



/6164 



Graphics_i J roperty_Part 


GRAPHICS NO. 


TYPE 


we 


HANDLERNO 




TIME 




0 


BUTTON 


(20.20) 


0 


Visible 


1996.9.9.15:00:00 


Invisible 


1 


3UTT0N 


(20,60) 


1 


Visible 


1996.9.9.15:00:00 


Invisible 


2 


wm 


( 0.20) 


NONE 


Invisible 


1996.9.9.15:00:00 


Visible 



Bitmap_Information_Part 




NUMBER 


0 


1 


2 


com 


VIDEO 


STEREO 


THIS OFFER IS 
NO LONGER VALID 







,6165 



Hyperlink_Information_Part 



LINK NO. 


LINK DESTINATION MATERIAL ID 


O 


NE id=l.VE id=l 


1 


NE_id=2.VE_id=2 



6166 



62 



EP0 830 019 A2 



FIG. 25 

( START ^) 



S6510 



FIRST CONTENT INDICATED j -" 
PRESENT TIME OBTAINED i^ S6520 



r 



ADJUSTMENT FOR TIME DIFFERENCE 



r 



S6530 



ONE SET OF GRAPHICS SELECTEDp S654Q , 




S6570 



GRAPHICS HIDDEN I 
I 



SELECTION POINTER MOVED IN 
ACCORDANCE WITH THE USER INPUT I 



36590 




S6610 



63 



EP0 830 019 A2 



FIG. 26 



6810' 



6820' 



TIME 



1996.9.9 
14 : 59 : 00 



1996.9.9 
15 : 00 : 00 



DISPLAY SCREEN 





64 



EP0 830 019 A2 



FIG. 27 

NE_id | 0 |NESTARTTIME| 1996.9.9.14:00:00 | ^ 716 ° 



Time Event Part 



ACTIVATE TIME 


HANDLER NO. 


1996.9.9,15 : 00 : 00 


2 



Bytecode_Part 



BYTECODENO. 


BYTECODE 


0 


PushLO.GotoPage 


1 


PushLl.GotoPage 


2 


PushL2,PushL 1 .SetGraphic Visibility, 
PushLO.PushLO.SetGraphicVisibility, 
PushLl ,PushLO,SetGraphicVisibility 



Handler_Part 






HANDLER NO. 


BYTECODENO. 






0 


0 






1 


1 






2 


2 





Graphics_Property_Parr 



GRAPHICS NO. 


TYPE 


COORDINATES 


IANDLEM 


ENrnALSTATE 


0 


BUTTON 


(20,20) 


0 


Visible 


1 


BUTTON 


(20,60) 




Visible 


2 


BUTTON 


( 0,20) 


NONE 


Invisible 



Bitmap_Information_Part 




NUMBER 


0 


1 


2 


CONM 


VIDEO 


STEREO 


THIS OFFER IS 
NO LONGER VALID 







Hyperlink_Information_Part 



LINK NO. 


LINK DESTINATION MATERIAL ID 


0 


NE id=l,VE id=l 


1 


NE id=2.VE id=2 



,7161 



7162 



,7163 



7164 



,7165 



,7166 



65 



EP0 830 019 A2 



FIG. 28 



S7510 




i , S7520 

PRESENT TIME OBTAINED f S753 o 



ADJUSTMENT FOR TIME DIFFERENCE | 

S7540 

REACHED? 




66 



EP0 830 019 A2 



FIG. 29 



QUESTION: 

WHICH IS A RED FRUIT? 



APPLE 




TANGERINE 



CORRECT 




T 



8200 




8030 



10 SECONDS AFTER DISPLAY | 
OF QUESTION 




INCORRECT 



8400 



TIME UP! 

THE CORRECT ANSWER 
IS APPLE 




67 



EP0 830 019 A2 



FIG. 31 



NE id 



8160 



Time Event Part 



elapsedhmebeforeaotva™ 


HANDLER NO. 


00 : 00 : 10 : 00 


2 



Bytecode_Part 



Handler Part 



HANDLER NO. 


BYTECODENO. 


0 


0 


1 


1 


2 


2 



Graphics_Property_Parr 



,8161 



BYTECODENO. 


BYTECODE 


0 


PushLO.GotoPage 


1 


PushLl.GotoPage 


2 


PushL2,GotoPage 



,8162 



8163 







«i!i^iit»i^!i]iat»[i]!i»iiniKiiifjiia 


0 


BUTTON 


(2U.2UJ 


0 


Visible 


i 


BUTTON 


(20,60) 


1 


Visible 



Bitmap_Information_Part 






NUMBER 


0 


1 




COMNT 






APPLE 


TANGERINE 







r8164 



8165 



Hyperlink_Information_Part 



r 



LINK NO. 


LINK DESTINATION MATERIAL ID 


0 


NE id=l.VE id = l 


1 


NE id=2.VE id=2 


2 


NE_id=3.VE_id=3 



,8166 



69 



EP0 830 019 A2 



FIG. 32 




START 



FIRST CONTENT INDICATED \ 



S8510 




■ YF„S ^S8530 

CONTENT DISPLAYED f 



ISTHEREA 



,S8540 



I PERIOD INDICATION IN THE Time Event 



NO 1 



OFTHENE? 



S8550 



TIME PERIOD INDICATION FLAG= 1 1 [TIME PERIOD INDICATION FLAG=0 1 



S8560 



S8570 




YES 



S8580 



PRESENT TIME 
OBTAINED 




SELECTION POINTER MOVED IN i S8600 
ACCORDANCE WITH USER INPUT 




YES 



,S8620 



70 



EP0 830 019 A2 

FIG. 33A 



8910 



8920 



ELAPSED TIME AND OPERATION 


DISPLAY SCREEN 


on • oo • on • nn 




QUESTION: 
WHICH ISAREDFl 

| APPLE 
TANGERINE 


Run? 




00 : 00 : 05 : 00 
"APPLE" SELECTED 




CORRECT 

© 

/ 
\ 





FIG. 33B 



ELAPSED TIME AND OPERATION 



8930' 



00 : 00 : 00 : 00 



8940 



00 : 00 : 10 : 00 



DISPLAY SCREEN 





71 



EP0 830 019 A2 



O 




72 



EP0 830 019 A2 



c 



FIG. 35 

START 



< 


^SlOllO 


ONE SUB-HANDLER SELECTED |- 


1 

NE id,VE id OF LINK 
DESTINATION CONTENT 
INDICATED BY GotoPage OBTAINED 


^ S10120 


^^^^--^^.sioiao 

^ISTHERE ANOTHER^O^ 5 



SUB-HANDLER? 
NO 



DISPLAY OF FIGURES REPRESENTING CONTENTS \* 



S10140- 



BROKEN LINE DRAWN BETWEEN CONTENTS | -" S1Q1 50 

J-.S10160 



TIME INPUT RECEIVED FROM USER 

s 



ONE SUB-HANDLER SELECTED^ 



S10170 



IS INDICATED 
IMEVALDJ 

YES 



S10180 




S10190 



NEjd.VE id OF LINK DESTINATION 
CONTENT INDICATED BY GOTOPAGE 
OBTAINED 



YES, 



tr „ T ™„^ SI 0200 
IS THERE 

JOTHER SUB-HANDLERS 



NO 



/S10210 



SOLID LINE DRAWN BETWEEN CONTENTS 
BASED ON OBTAINED NEJD 1 



C 



END 



73 



EP0 830 019 A2 



FIG. 36 



10300 




_^10400 




74 



EP0 830 019 A2 




EP0 830 019 A2 



FIG. 38 



C 



START 



ONE SUB-HANDLER SELECTED | -" S 101 10 
NE_id,VE-id OF LINK" 



DESTINATION CONTENT j-- 



S10120 



INDICATED BY GotoPage OBTAINED 1 



S10130 

TS THERE ANOTHER — YES 
iUB-HANDLE 

NO 



DISPLAY OF FIGURE REPRESENTING CONTENT^ S 1 0 1 40 
BROKEN LINE DRAWN BETWEEN CONTENTS^ s 1 0 1 50 



TIME INPUT RECEIVED FROM USER 



It 



S10160 



ONE SUB-HANDLER SELECTED 




S10170 



S10190 



NE_ID,VE-ID OF LINK DESTINATION 
CONTENT INDICATED BY GOTOPAGE 
OBTAINED 




SI 02 10 



SOLID LINE DRAWN BETWEEN CONTENTSl 
B ASED ON f)BTAINF^NEJp, 



RECEPTION OF SELECTION 
OF NON-LINK DESTINATION 
CONTENT BY THE USER 



r 



S10610 



-S10620 



SEARCH FOR SUB-HANDLER TO BE UPDATED \ " * 

-S10630 



VALID PERIOD FOR SUB-HANDLER 
UPDATED . 



C 



END 



76 



